-- Logs begin at Mon 2022-05-16 14:11:28 UTC, end at Mon 2022-05-16 15:34:54 UTC. -- May 16 15:05:31.604393 dv-cinder-795785-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 15:05:31.611728 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 15:05:31.613681 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 15:05:31 2022] *** May 16 15:05:31.613681 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 15:05:31.613681 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 15:05:31.613681 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: nodename: dv-cinder-795785-10-iscsi May 16 15:05:31.613681 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: machine: x86_64 May 16 15:05:31.613681 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: clock source: unix May 16 15:05:31.613681 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: pcre jit disabled May 16 15:05:31.614196 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: detected number of CPU cores: 4 May 16 15:05:31.614196 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: current working directory: / May 16 15:05:31.614196 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: detected binary path: /usr/bin/uwsgi-core May 16 15:05:31.614196 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: your processes number limit is 47680 May 16 15:05:31.614196 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: your memory page size is 4096 bytes May 16 15:05:31.614196 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: detected max file descriptor number: 2048 May 16 15:05:31.614196 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: lock engine: pthread robust mutexes May 16 15:05:31.614196 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: thunder lock: enabled May 16 15:05:31.614196 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 15:05:31.614902 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 15:05:31.660111 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: Python main interpreter initialized at 0x564d8c8bc9c0 May 16 15:05:31.660111 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: python threads support enabled May 16 15:05:31.660111 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: your server socket listen backlog is limited to 100 connections May 16 15:05:31.660111 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: your mercy for graceful operations on workers is 90 seconds May 16 15:05:31.660492 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: mapped 403077 bytes (393 KB) for 2 cores May 16 15:05:31.660569 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: *** Operational MODE: preforking *** May 16 15:05:31.660831 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: *** uWSGI is running in multiple interpreter mode *** May 16 15:05:31.660831 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: spawned uWSGI master process (pid: 103254) May 16 15:05:31.661018 dv-cinder-795785-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 15:05:31.665056 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: spawned uWSGI worker 1 (pid: 103255, cores: 1) May 16 15:05:31.665056 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: spawned uWSGI worker 2 (pid: 103256, cores: 1) May 16 15:05:31.665056 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 15:05:32.845244 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:05:32.922792 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:05:33.574678 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:05:33.574678 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: from cryptography.utils import int_from_bytes May 16 15:05:33.574997 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:05:33.574997 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: from cryptography.utils import int_from_bytes May 16 15:05:33.670760 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:05:33.670760 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: from cryptography.utils import int_from_bytes May 16 15:05:33.671072 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:05:33.671072 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: from cryptography.utils import int_from_bytes May 16 15:05:36.150346 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:05:36.150864 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:05:36.151110 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:05:36.151469 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:05:36.151722 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:05:36.152102 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.152429 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.152743 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.153058 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.153383 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.153692 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.154009 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.154351 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.154674 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.154934 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.155248 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.155568 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-10-iscsi {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.155887 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.156190 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.156497 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.156809 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.157111 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.157427 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.157730 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.158246 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.158675 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.158983 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.159289 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.159641 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.159932 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.160254 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.160554 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.160857 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.161177 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.161479 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.162427 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-10-iscsi {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.162765 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.163085 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.163398 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.163810 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.164119 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.164424 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.164740 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.165056 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.165360 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.165679 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.165994 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.166333 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.166649 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.166947 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.167251 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.167555 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.167868 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.168171 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.168471 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.168718 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.169026 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.169342 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.169661 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.169984 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.170245 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.170498 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.170812 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.171128 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.171435 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.171735 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.172036 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.172346 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.172649 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.172948 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.173247 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.173549 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.173861 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.174190 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.174510 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.174813 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.175128 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.175521 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.175770 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.176073 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.176407 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.176721 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.177026 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.177886 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.178240 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.178548 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.178852 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.179154 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.179471 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.179794 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.180094 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.180345 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.180648 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.180950 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.181263 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.181565 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.181867 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.182195 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.182496 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.182796 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.183017 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:05:36.183405 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.183506 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:05:36.183597 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.183678 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.183796 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:05:36.183960 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.184162 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:05:36.184258 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.184424 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:05:36.184549 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.184814 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.184908 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.185140 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.185234 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.185452 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.185539 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.185766 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.185853 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.186097 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.186189 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.186390 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.186477 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.186693 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.186798 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.186997 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.187085 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.187315 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.187420 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.187617 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.187703 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.187917 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.188054 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.188237 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.188434 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-10-iscsi {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.188530 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.188826 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.188923 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.189139 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.189468 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.189584 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.189696 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.189790 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.189880 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.190041 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.190242 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.190358 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.190599 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.190694 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.190962 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.191053 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.191263 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.191466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.191614 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.191782 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.191865 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.192080 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.192178 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.192401 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.192521 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.192727 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.192816 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.193052 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.193146 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.193353 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.193449 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.193651 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.193744 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.193966 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.194076 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.194318 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.194423 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.194626 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.194713 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.194931 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.195064 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-10-iscsi {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.195234 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.195321 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.195551 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.195638 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.195885 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.195983 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.196214 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.196335 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.196552 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.196650 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.196866 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.196953 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.197195 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.197282 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.197523 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.197610 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.197839 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.197934 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.198172 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.198274 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.198484 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.198586 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.198807 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.198902 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.199116 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.199203 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.199422 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.199520 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.199727 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.199819 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.200036 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.200122 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.200347 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.200440 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.200654 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.200747 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.200961 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.201047 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.201215 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.201310 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.201527 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.201652 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.201852 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.201946 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.202193 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.202299 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.202521 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.202609 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.202774 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.202863 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.203028 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.203116 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.203350 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.203445 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.203673 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.203782 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.203984 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.204079 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.204294 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.204392 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.204601 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.204696 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.204911 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.205001 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.205267 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.205359 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.205579 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.205677 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.205897 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.205986 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.206247 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.206335 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.206564 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.206671 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.206877 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.206964 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.207187 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.207339 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.207497 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.207696 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.207805 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.208070 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.208156 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.208424 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.208561 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.208759 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.208847 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.209072 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.209166 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.209386 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.209526 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.209695 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.209781 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.210008 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.210116 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.210339 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.210445 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.210647 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.210734 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.210953 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.211039 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.211256 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.211356 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.211557 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.211643 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.211861 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.211950 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.212174 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.212274 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.212475 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.212565 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.212778 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.212863 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.213082 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.213170 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.213393 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.213481 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.213715 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.213801 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.214017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.214140 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.214346 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.214434 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.214656 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.214740 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.214962 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.215057 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.215261 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.215346 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.215568 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.215653 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.215875 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.215961 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.216176 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.216270 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.216481 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.216579 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.216787 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.216889 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.217087 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.217185 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.217392 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.217478 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.217698 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.217784 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.218000 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.218137 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.218336 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.218425 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.218647 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.218735 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.218953 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.219037 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.219257 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.219352 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.219564 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.219663 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.219883 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.219968 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.220190 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.220284 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.220495 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.220587 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.220818 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.220904 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.221127 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.221223 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.221435 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.221521 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.221755 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.221886 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.222082 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.222186 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.222397 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.222484 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.222697 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.222783 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.223007 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.223112 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.223309 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.223397 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.223613 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.223700 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.223918 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.224018 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.224759 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.224880 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.225062 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.225258 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.225355 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.225623 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.225710 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.225941 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.226027 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.226266 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.226364 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.226586 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.226695 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.226891 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.227008 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.227193 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.227318 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.227493 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.227643 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.227791 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.227992 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.228125 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.228309 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.228409 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.228647 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.228747 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.228957 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.229061 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.229282 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:05:36.229369 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.229644 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.229731 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.229968 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.230117 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.230307 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.230396 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.230618 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.230712 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.230927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.231023 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.231236 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.231323 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.231544 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.231652 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.231862 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.231991 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.232175 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.232287 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.232491 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.232619 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.232799 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.232937 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.233121 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.233255 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.233428 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.233572 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.233742 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.233897 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.234045 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.234328 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.234429 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.234652 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.234751 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.234990 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.235077 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.235323 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.235416 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.235642 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.235741 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.235949 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.236035 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.236262 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.236356 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.236570 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.236665 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.236875 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.236961 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.237181 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.237266 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.237488 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.237641 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.237801 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.237999 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.238240 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.238329 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.238561 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.238685 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.238869 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.238955 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.239188 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.239276 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.239494 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.239590 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.240383 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.240489 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.240690 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.240786 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.241004 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.241090 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.241331 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.241425 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.241661 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.241762 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.241970 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.242130 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.242307 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.242407 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.242626 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.242750 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.242935 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.243118 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.243244 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.243410 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.243649 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.243814 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.243962 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.244049 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.244304 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.244397 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.244614 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.244709 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.244930 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.245017 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.245239 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.245325 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.245548 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.245692 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.245851 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.245947 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.246186 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.246278 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.246494 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.246911 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.247058 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.247144 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.247359 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.247446 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.247664 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.247751 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.247982 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.248069 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.248290 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.248390 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.248606 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.248691 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.248924 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.249010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.249225 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.249321 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.249527 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.249614 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.249844 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.249930 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.250173 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.250281 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.250479 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.250588 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.250781 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.250904 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.251082 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.251219 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.251420 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.251530 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.251728 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.251858 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.252031 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.252179 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.252351 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.252490 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.252669 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.252818 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.252978 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.253128 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.253287 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.253437 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.253594 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.253755 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.253899 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.254098 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.254245 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.254408 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.254557 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.254723 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.254864 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.255037 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.255170 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.255388 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.255485 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.255707 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.255802 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.256023 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.256110 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.256363 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.256452 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.256693 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.256786 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.256999 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.257092 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.257305 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.257398 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.257606 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.257693 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.257912 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.257997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.258249 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.258351 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.258581 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.258817 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.258911 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.259149 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.259236 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.259464 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.259552 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.259779 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.259875 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.260096 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.260183 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.260412 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.260499 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.260726 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.260818 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.261052 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.261137 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.261380 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.261466 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.261683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.261778 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.261991 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.262125 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.262321 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.262421 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.262624 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.262712 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.262931 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.263017 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.263233 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.263369 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.263535 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.263631 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.263836 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.263923 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.264143 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.264238 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.264442 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.264529 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.264742 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.264837 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.265045 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.265132 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.265345 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.265468 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.265656 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.265827 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.265956 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.266191 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.266291 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.266532 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.266619 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.266871 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.266968 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.267176 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.267262 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.267477 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.267563 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.267777 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.267873 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.268077 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.268170 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.268417 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.268503 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.268720 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.268807 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.269040 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.269124 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.269348 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.269433 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.269666 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.269753 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.269991 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.270115 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.270321 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.270419 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.270644 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.270742 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.271476 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.271570 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.271783 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.271897 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.272090 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.272223 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.272398 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.272539 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.272706 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.272854 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.273008 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.273168 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.273318 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.273483 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.273625 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.273805 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.273934 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.274140 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.274265 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.274462 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.274549 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.274774 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.274870 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.275098 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.275184 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.275412 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.275499 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.275732 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.275826 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.276031 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.276129 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.276334 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.276435 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.276640 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.276779 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.276946 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.277204 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.277290 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.277523 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.277618 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.277826 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.277911 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.278165 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.278266 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.278471 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.278560 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.278773 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.278860 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.279074 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.279161 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.279381 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.279479 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.279685 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.279770 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.279983 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.280081 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.280300 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.280394 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.280608 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.280695 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.280910 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.281007 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.281211 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.281304 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.281516 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.281605 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.281817 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.281913 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.282143 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.282234 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.282451 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.282537 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.282769 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.282874 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.283082 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.283169 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.283382 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.283477 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.283688 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.283784 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.283989 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.284075 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.284288 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.284374 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.284588 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.284675 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.284891 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.284985 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.285189 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.285275 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.285488 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.285583 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.285787 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.285882 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.286107 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.286198 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.286409 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.286497 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.287286 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.287426 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.287592 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.287680 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.287893 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.287982 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.288194 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.288289 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.288491 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.288587 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.288828 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.288916 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.289129 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.289216 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.289464 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.289559 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.289777 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.289872 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.290115 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.290204 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.290431 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.290530 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.290739 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.290832 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.291046 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.291143 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.291357 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.291451 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.291659 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.291745 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.291971 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.292058 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.292283 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.292371 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.292593 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.292678 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.292892 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.292978 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.293198 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.293284 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.293508 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.293608 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.293816 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.293902 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.294150 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.294410 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.294498 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.294746 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.294832 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.295063 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.295162 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.295370 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.295455 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.295675 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.295761 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.295983 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.296071 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.296289 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.296375 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.296594 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.296681 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.296898 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.296986 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.297205 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.297308 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.297510 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.297597 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.297816 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.297979 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.298146 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.298252 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.298455 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.298542 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.298757 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.298853 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.299063 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.299148 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.299367 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.299453 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.299668 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.299764 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.299971 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.300056 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.300281 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.300369 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.300582 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.300678 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.300886 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.300973 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.301185 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.301273 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.301491 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.301587 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.301791 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.301886 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.302245 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.302340 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.302564 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.302652 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.302873 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.302960 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.303176 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.303270 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.303484 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.303571 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.303789 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.303875 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.304102 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.304189 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.304412 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.304499 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.304713 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.304798 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.305069 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.305162 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.305414 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.305501 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.305725 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.305819 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.306029 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.306191 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.306355 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.306446 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.306655 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.306743 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.306961 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.307057 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.307270 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.307357 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.307569 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.307655 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.307869 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.307965 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.308169 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.308256 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.308478 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.308562 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.308777 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.308872 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.309099 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.309198 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.309432 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.309518 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.309762 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.309850 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.310097 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.310189 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.310398 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.310534 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.310716 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.310842 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.311050 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.311138 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.311398 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.311494 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.311731 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.311819 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.312050 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.312137 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.312365 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.312496 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.312716 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.312852 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.313049 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.313137 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.313374 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.313469 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.313696 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.313781 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.314004 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.314121 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.314342 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.314440 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.314647 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.314789 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.314966 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.315123 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.315284 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.315473 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.315596 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.315805 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.315956 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.316156 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.316404 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.316492 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.316731 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.316829 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.317035 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.317123 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.317353 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.317442 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.317680 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.317825 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.318011 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.318192 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.318338 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.318565 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.318654 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.318917 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.319004 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.319229 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.319367 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.319549 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.319637 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.319852 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.319966 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.320160 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.320292 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.320466 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.320604 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.320772 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.320915 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.321074 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.321230 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.321375 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.321536 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.321691 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.321843 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.321994 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.322181 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.322350 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.322488 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.322665 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.322796 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.322984 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.323121 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.323302 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.323433 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.323603 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.323740 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.323921 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.324126 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.324224 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.324479 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.324567 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.324801 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.324896 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.325098 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.325193 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.325437 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.325626 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.325723 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.325993 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.326099 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.326346 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.326433 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.326677 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.326773 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.326997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.327083 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.327315 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.327409 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.327636 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.327725 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.327944 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.328029 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.328257 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.328357 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.328572 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.328658 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.328917 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.329011 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.329172 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.329268 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.329478 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.329574 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.329780 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.329875 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.330128 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.330219 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.330446 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.330535 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.330755 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.330903 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.331055 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.331142 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.331355 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.331443 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.331655 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.331743 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.331975 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.332062 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.332282 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.332382 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.332594 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.332687 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.332897 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.333022 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.333200 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.333297 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.334131 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.334228 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.334449 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.334545 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.334765 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.334866 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.335084 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.335173 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.335400 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.335487 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.335712 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.335809 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.336028 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.336116 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.336342 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.336430 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.336649 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.336737 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.336972 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.337060 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.337284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.337370 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.337593 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.337681 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.337905 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.337999 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.338236 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.338338 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.338548 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.338685 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.338854 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.338940 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.339165 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.339281 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.339472 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.339597 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.339786 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.339911 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.340098 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.340220 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.340412 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.340533 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.340846 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.340971 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.341167 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.341265 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.341486 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.341573 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.341793 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.341881 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.342168 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.342273 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.342483 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.342570 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.342794 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.342882 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.343103 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.343200 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.343411 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.343499 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.343718 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.343813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.344026 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.344117 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.344350 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.344436 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.344656 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.344741 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.344963 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.345051 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.345270 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.345378 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.345595 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.345690 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.345906 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.345994 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.346261 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.346363 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.346621 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.346767 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.346974 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.347116 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.347288 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.347377 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.347593 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.347692 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.347905 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.347992 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.348218 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.348305 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.348532 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.348621 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.348844 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.348932 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.349711 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.349809 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.350024 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.350199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.350358 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.350570 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.350657 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.350925 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.351029 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.351258 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.351345 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.351569 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.351656 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.351891 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.351988 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.352229 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.352324 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.352547 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.352634 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.352857 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.352946 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.353178 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.353273 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.353495 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.353593 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.353949 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.354036 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.354342 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.354429 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.354673 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.354769 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.355001 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.355102 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.355319 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.355407 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.355634 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.355812 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.355951 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.356187 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.356300 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.356535 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.356623 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.356856 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.356945 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.357161 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.357249 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.357469 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.357555 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.357768 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.357863 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.358111 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.358202 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.358421 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.358507 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.358726 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.358828 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.359037 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.359124 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.359343 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.359437 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.359648 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.359878 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.359966 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.360226 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.360314 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.360544 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.360632 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.360874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.360970 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.361239 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.361336 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.361559 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.361656 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.361866 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.361953 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.362219 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.362307 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.362528 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.362617 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.362832 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.362919 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.363135 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.363222 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.363444 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.363543 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.363746 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.363835 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.364049 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.364146 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.364359 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.364492 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.365251 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.365350 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.365557 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.365658 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.365869 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.365964 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.366194 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.366288 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.366524 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.366626 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.366830 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.366965 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.367134 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.367223 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.367438 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.367529 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.367747 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.367836 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.368050 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.368137 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.368352 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.368447 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.368657 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.368744 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.368957 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.369042 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.369262 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.369350 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.369560 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.369653 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.369863 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.369949 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.370188 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.370279 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.370495 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.370592 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.370793 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.370880 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.371101 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.371197 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.371424 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.371784 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.372004 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.372100 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.372310 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.372405 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.372609 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.372695 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.372921 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.373021 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.373230 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.373317 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.373551 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.373640 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.373861 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.373962 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.374198 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.374290 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.374544 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.374630 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.374856 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.374960 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.375245 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.375386 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.375572 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.375719 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.375895 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.376039 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.376215 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.376368 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.376547 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.376695 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.376868 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.377001 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.377189 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.377314 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.377509 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.377620 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.377829 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.377943 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.378166 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.378280 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.378487 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.378573 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.378805 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.378895 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.379126 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.379213 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.379476 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.379655 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.379782 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.379989 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.380076 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.380922 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.381021 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.381247 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.381336 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.381551 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.381636 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.381856 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.381944 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.382189 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.382280 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.382504 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.382592 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.382843 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.382943 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.383160 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.383249 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.383474 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.383608 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.383786 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.383884 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.384099 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.384187 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.384405 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.384523 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.384711 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.384901 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.385016 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.385227 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.385315 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.385569 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.385664 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.385913 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.386000 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.386250 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.386338 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.386555 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.386655 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.386968 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.387056 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.387278 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.387364 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.387596 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.387687 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.387914 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.388000 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.388220 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.388307 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.388534 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.388621 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.388849 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.388936 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.389157 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.389243 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.389471 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.389565 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.389776 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.389862 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.390127 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.390230 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.390462 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.390556 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.390786 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.390876 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.391107 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.391204 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.391409 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.391569 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.391709 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.391902 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.392010 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.392227 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.392322 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.392547 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.392634 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.392869 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.392956 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.393204 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.393421 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.393508 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.393810 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.393898 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.394137 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.394227 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.394439 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.394527 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.394740 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.394895 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.395040 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.395218 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.395346 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.395544 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.395637 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.395934 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.396038 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.396244 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.396329 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.396554 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.396687 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.397024 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.397123 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.397303 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.397424 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.397611 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.397737 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.397914 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.398093 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.398255 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.398410 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.398556 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.398725 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.398857 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.399054 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.399142 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.399370 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.399466 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.399790 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.399955 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.400106 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.400342 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.400433 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.400669 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.400765 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.401027 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.401114 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.401333 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.401422 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.401650 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.401746 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.401968 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.402069 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.402304 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.402392 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.402612 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.402711 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.402943 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.403030 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.403252 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.403341 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.403561 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.403659 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.403868 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.403957 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.404178 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.404266 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.404483 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.404571 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.404790 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.404914 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.405097 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.405183 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.405409 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.405497 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.405711 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.405798 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.406029 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.406159 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.406374 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.406465 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.406693 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.406780 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.407008 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.407096 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.407317 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.407405 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.407644 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.407731 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.407953 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.408049 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.408257 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.408344 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.408561 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.408646 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.408866 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.408962 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.409171 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.409257 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.409483 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.409569 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.409790 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.409884 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.410128 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.410230 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.410440 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.410535 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.410746 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.410834 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.411069 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.411156 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.411390 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.411497 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.411758 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.411858 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.412069 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.412156 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.412413 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.412537 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.412740 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.412836 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.413063 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.413150 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.413375 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.413517 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.413680 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.413867 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.413953 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:05:36.414313 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.414662 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.415264 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.415631 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.416005 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.416395 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.416733 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.417048 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.417362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.417718 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.418122 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.418472 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.418808 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.419149 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.419504 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.419842 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.420212 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.420558 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.420878 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.421217 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.421563 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.421918 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.422286 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.422653 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.423043 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.423402 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.423744 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.424133 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.424513 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.424892 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.425209 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.425527 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.425841 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.426188 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.426524 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.426843 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.427687 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.428116 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.428437 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.428764 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.429090 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.429407 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.429733 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.430074 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.430399 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.430726 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.431041 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.431375 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.431718 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.432050 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.432379 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.432695 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.433018 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.433317 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.433775 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.433954 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.434293 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.434601 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.434909 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.435224 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.435533 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.435842 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.436150 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.436455 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.436767 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.437150 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.437506 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.437592 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_db.sqlalchemy.engines [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:36.437819 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.438202 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.438557 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.438927 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.439267 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.439604 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.439915 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.440225 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.440535 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.440845 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.441183 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.441521 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.441842 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.442193 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.442510 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.443386 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.443733 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.444080 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.444411 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.444735 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.445049 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.445387 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.445701 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.446016 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.446364 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.446680 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.446993 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.447306 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.447639 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.447972 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.448262 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.448591 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.448913 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.449238 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.449559 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.449873 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.450229 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.450576 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.450928 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.451252 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.451566 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.451902 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.452223 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.452569 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.452899 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.453232 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.453547 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.453876 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.454240 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.454595 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.454911 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.455259 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.455594 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.455912 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.456228 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.456538 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:05:36.456786 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:05:36.480169 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:36.500166 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.context [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1579528c-849f-42a7-b29b-4c61d7971040(cell1) {{(pid=103256) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:05:36.504525 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:05:36.506729 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:05:36.507508 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:05:36.509455 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:05:36.519942 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_db.sqlalchemy.engines [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:36.523678 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_db.sqlalchemy.engines [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:36.546439 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.context [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1579528c-849f-42a7-b29b-4c61d7971040(cell1) {{(pid=103255) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:05:36.550760 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG oslo_concurrency.lockutils [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:05:36.552882 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG oslo_concurrency.lockutils [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:05:36.553673 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG oslo_concurrency.lockutils [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:05:36.555675 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG oslo_concurrency.lockutils [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:05:36.569527 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:36.573056 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:36.681110 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_db.sqlalchemy.engines [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:36.731252 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:05:37.089554 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: WARNING keystonemiddleware.auth_token [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:05:37.097069 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: WARNING keystonemiddleware.auth_token [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:05:37.119448 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: WARNING keystonemiddleware.auth_token [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:05:37.127068 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: WARNING keystonemiddleware.auth_token [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:05:37.441136 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: WARNING keystonemiddleware.auth_token [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:05:37.447182 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: WARNING keystonemiddleware.auth_token [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:05:37.453169 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d8c8bc9c0 pid: 103256 (default app) May 16 15:05:37.455229 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:05:37.456493 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001796 May 16 15:05:37.456906 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Mon May 16 15:05:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:05:37.476849 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: WARNING keystonemiddleware.auth_token [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:05:37.483011 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: WARNING keystonemiddleware.auth_token [None req-e0f1d75d-f41c-4d88-8255-a6e4d7ba9993 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:05:37.489129 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d8c8bc9c0 pid: 103255 (default app) May 16 15:06:57.395499 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:06:57.397088 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 May 16 15:06:57.399602 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:06:57.810283 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-eb50e19f-2b66-4cd5-886d-b14a86412c8a admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:06:57.839208 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-eb50e19f-2b66-4cd5-886d-b14a86412c8a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.434740 May 16 15:06:57.839863 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 16 15:06:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:00.115762 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:00.117486 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-0f13e387-e044-41a8-98bf-949c72d1e89c None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002137 May 16 15:07:00.118863 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:00.181800 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-7dde6142-6e69-4907-a4ed-a9df6bea695c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "name": "cirros256", "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256}} {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:00.199810 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:07:00.199810 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: warnings.warn(msg) May 16 15:07:00.276725 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-7dde6142-6e69-4907-a4ed-a9df6bea695c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.151817 May 16 15:07:00.284085 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 16 15:07:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:00.493638 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-9559d4e3-c4a4-459f-b495-68ceff19b638 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:00.496055 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:07:00.496055 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 16 15:07:00.641191 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-9559d4e3-c4a4-459f-b495-68ceff19b638 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.355760 May 16 15:07:00.658092 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 16 15:07:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:02.901746 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-7dde6142-6e69-4907-a4ed-a9df6bea695c admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:02.902789 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-7dde6142-6e69-4907-a4ed-a9df6bea695c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 16 15:07:02.903184 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:03.004823 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-fe12c96e-62c4-4afe-80bb-34383bbaa9a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:03.023247 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:07:03.023247 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 16 15:07:03.148196 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-fe12c96e-62c4-4afe-80bb-34383bbaa9a9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.238177 May 16 15:07:03.148785 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 16 15:07:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:03.163291 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-67423ce7-3c4b-4427-a45a-b83985297524 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:03.166003 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:07:03.166003 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: warnings.warn(msg) May 16 15:07:03.287357 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-67423ce7-3c4b-4427-a45a-b83985297524 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129611 May 16 15:07:03.288017 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 16 15:07:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:05.541346 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-fe12c96e-62c4-4afe-80bb-34383bbaa9a9 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:05.542444 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-fe12c96e-62c4-4afe-80bb-34383bbaa9a9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 May 16 15:07:05.543291 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:05.612624 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-7297f711-2690-4f32-8521-a14409ef69df admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "ram": 1024}} {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:05.695618 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-7297f711-2690-4f32-8521-a14409ef69df admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145400 May 16 15:07:05.696621 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 16 15:07:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:07:05.708258 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-65c8c309-8c02-489a-9c49-9f9d18224c8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:05.795703 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-65c8c309-8c02-489a-9c49-9f9d18224c8b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090944 May 16 15:07:05.796526 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 16 15:07:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:08.067310 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-7297f711-2690-4f32-8521-a14409ef69df admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:08.068323 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-7297f711-2690-4f32-8521-a14409ef69df admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 16 15:07:08.069162 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:08.129115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-3159898b-8fdc-4f0d-96dd-15d67e9fb703 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "swap": 0, "ram": 2048}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:08.220890 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-3159898b-8fdc-4f0d-96dd-15d67e9fb703 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145818 May 16 15:07:08.221459 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 16 15:07:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:08.233665 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-3e413e02-0373-4a07-a84d-1e4687365fc9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:08.309769 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-3e413e02-0373-4a07-a84d-1e4687365fc9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080156 May 16 15:07:08.310427 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 16 15:07:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:10.592596 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-3159898b-8fdc-4f0d-96dd-15d67e9fb703 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:10.593618 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-3159898b-8fdc-4f0d-96dd-15d67e9fb703 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 16 15:07:10.594074 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:10.653796 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-67e81ff3-33ae-46c6-a8fc-c10a7771d6f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "name": "ds4G", "disk": 20}} {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:10.741903 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-67e81ff3-33ae-46c6-a8fc-c10a7771d6f4 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141812 May 16 15:07:10.742526 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 16 15:07:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:10.754985 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-b367e7f5-e06d-4610-93cb-619c2c633d3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:10.833276 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-b367e7f5-e06d-4610-93cb-619c2c633d3f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082067 May 16 15:07:10.844881 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 16 15:07:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:13.079195 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-67e81ff3-33ae-46c6-a8fc-c10a7771d6f4 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:13.081261 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-67e81ff3-33ae-46c6-a8fc-c10a7771d6f4 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002489 May 16 15:07:13.083240 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:13.139337 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-a726e37f-bd67-4f03-a033-046b93b3855f admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:13.162591 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-a726e37f-bd67-4f03-a033-046b93b3855f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.074969 May 16 15:07:13.163296 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 16 15:07:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:07:15.429503 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-67e81ff3-33ae-46c6-a8fc-c10a7771d6f4 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:15.430914 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-67e81ff3-33ae-46c6-a8fc-c10a7771d6f4 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 May 16 15:07:15.431483 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:15.489096 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-921f2dc5-1ddd-4325-8e50-7b004759c096 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:15.605985 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-921f2dc5-1ddd-4325-8e50-7b004759c096 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.168765 May 16 15:07:15.606572 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 16 15:07:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:15.618635 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-c18f35e9-6567-48e2-b689-965b20546a6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:15.695138 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-c18f35e9-6567-48e2-b689-965b20546a6d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080448 May 16 15:07:15.695796 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 16 15:07:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:07:17.969870 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-921f2dc5-1ddd-4325-8e50-7b004759c096 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:17.970915 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-921f2dc5-1ddd-4325-8e50-7b004759c096 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 May 16 15:07:17.971324 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:18.029296 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-19576322-e277-44b9-99c5-5695b88e2eb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "2", "ram": 2048, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:18.127615 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-19576322-e277-44b9-99c5-5695b88e2eb5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.150702 May 16 15:07:18.128173 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 16 15:07:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:07:18.139687 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-c0fc7767-d6a6-44ea-b4ef-070b358f6a21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:18.233705 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-c0fc7767-d6a6-44ea-b4ef-070b358f6a21 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097582 May 16 15:07:18.234249 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 16 15:07:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:20.454286 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-19576322-e277-44b9-99c5-5695b88e2eb5 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:20.455406 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-19576322-e277-44b9-99c5-5695b88e2eb5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 May 16 15:07:20.455880 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:20.512832 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-a9adb072-cbb7-460e-9adb-41ff1c451607 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "name": "m1.medium"}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:20.613130 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-a9adb072-cbb7-460e-9adb-41ff1c451607 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.150969 May 16 15:07:20.613682 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 16 15:07:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:20.625193 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-545b11a9-dbdd-4c4d-9d27-e6b64038ed00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:20.706311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-545b11a9-dbdd-4c4d-9d27-e6b64038ed00 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084553 May 16 15:07:20.706877 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 16 15:07:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:22.956910 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-a9adb072-cbb7-460e-9adb-41ff1c451607 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:22.957905 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-a9adb072-cbb7-460e-9adb-41ff1c451607 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 16 15:07:22.958746 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:23.014810 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-04341e1a-3f92-4401-805b-dc89d44bb3ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "id": "4", "swap": 0}} {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:23.141132 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-04341e1a-3f92-4401-805b-dc89d44bb3ca admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.173192 May 16 15:07:23.141132 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 16 15:07:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:23.149736 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-b2cca14e-1028-40ec-ad16-22daaf7daa52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:23.239275 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-b2cca14e-1028-40ec-ad16-22daaf7daa52 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093056 May 16 15:07:23.239979 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 16 15:07:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:25.503412 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-04341e1a-3f92-4401-805b-dc89d44bb3ca admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:25.522283 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-04341e1a-3f92-4401-805b-dc89d44bb3ca admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 16 15:07:25.522283 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:25.579238 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-9e2f0461-9b47-481d-bbf7-196e03452f9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:26.050696 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-9e2f0461-9b47-481d-bbf7-196e03452f9c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.540229 May 16 15:07:26.053509 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 16 15:07:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:26.068549 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-e7a9b087-0456-499f-8c3e-67e6c8174f52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:26.156517 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-e7a9b087-0456-499f-8c3e-67e6c8174f52 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091663 May 16 15:07:26.157545 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 16 15:07:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:07:50.133690 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-9e2f0461-9b47-481d-bbf7-196e03452f9c admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:50.134775 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-9e2f0461-9b47-481d-bbf7-196e03452f9c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 16 15:07:50.135178 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:07:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:50.191577 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-7f17a8a9-ccf6-4922-90f7-2dd96412f862 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:50.208480 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-7f17a8a9-ccf6-4922-90f7-2dd96412f862 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066947 May 16 15:07:50.209014 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 16 15:07:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:07:51.206159 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-9e2f0461-9b47-481d-bbf7-196e03452f9c admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:51.207191 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-9e2f0461-9b47-481d-bbf7-196e03452f9c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 16 15:07:51.207609 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:07:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:51.401160 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-55be4b28-8a75-4765-972a-93fcfb3c50e4 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:51.407086 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.wsgi [None req-55be4b28-8a75-4765-972a-93fcfb3c50e4 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-55be4b28-8a75-4765-972a-93fcfb3c50e4 admin admin] Request method failure captured: May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Accept: application/json May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Accept-Encoding: gzip, deflate May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Connection: keep-alive May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Content-Length: 0 May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Host: 10.222.0.44 May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Openstack-Api-Version: compute 2.90 May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Openstack-System-Scope: None May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: User-Agent: python-novaclient May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Auth-Token: gAAAAABigmjHX98XMKdRvAwtN2eeNkH38kcm6w81v-8bBBNRTU5VfDO1Baiop07Jz2VvQTpIDsmapPS4g354jnK8jRPKzqZZ8PD6chYl6zeJaLdLd_A2YZ166v1Ji37tR9vmmuxHOnLfOHcdHiRb5m5dvQ0x4QY4UO8thz_hSyPQjgmD9g6_324 May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Domain-Id: None May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Domain-Name: None May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Identity-Status: Confirmed May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Is-Admin-Project: True May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Domain-Id: default May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Domain-Name: Default May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Name: admin May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Role: reader,member,admin May 16 15:07:51.410362 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Roles: reader,member,admin May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_205b1267d8204d608304e6a78a0e361f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Tenant: admin May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Tenant-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Tenant-Name: admin May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User: admin May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Domain-Id: default May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Domain-Name: Default May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Id: efb24a53849544a0bc7346ef2b1d8c20 May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Name: admin May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: method: > May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: exception: Flavor 42 could not be found. May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: action_args: {'id': '42'} May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:07:51.412032 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:51.413311 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:51.414811 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-55be4b28-8a75-4765-972a-93fcfb3c50e4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:07:51.416083 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-55be4b28-8a75-4765-972a-93fcfb3c50e4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060190 May 16 15:07:51.416083 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 16 15:07:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:07:51.421901 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-e34c0bb2-ddcc-4daa-890d-a188402ca648 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:51.443121 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-e34c0bb2-ddcc-4daa-890d-a188402ca648 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025358 May 16 15:07:51.443633 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 16 15:07:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:07:51.459253 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-7a101681-24cf-44eb-94c2-b9fcc7ccb1b7 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:51.481056 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-7a101681-24cf-44eb-94c2-b9fcc7ccb1b7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024752 May 16 15:07:51.481582 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 16 15:07:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:07:51.490509 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-17b2f562-35bb-40aa-b7e5-e4ecb7c01143 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:51.495886 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.wsgi [None req-17b2f562-35bb-40aa-b7e5-e4ecb7c01143 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-17b2f562-35bb-40aa-b7e5-e4ecb7c01143 admin admin] Request method failure captured: May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Accept: application/json May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Accept-Encoding: gzip, deflate May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Connection: keep-alive May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Content-Length: 0 May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Host: 10.222.0.44 May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Openstack-Api-Version: compute 2.90 May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Openstack-System-Scope: None May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: User-Agent: python-novaclient May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Auth-Token: gAAAAABigmjHX98XMKdRvAwtN2eeNkH38kcm6w81v-8bBBNRTU5VfDO1Baiop07Jz2VvQTpIDsmapPS4g354jnK8jRPKzqZZ8PD6chYl6zeJaLdLd_A2YZ166v1Ji37tR9vmmuxHOnLfOHcdHiRb5m5dvQ0x4QY4UO8thz_hSyPQjgmD9g6_324 May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Domain-Id: None May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Domain-Name: None May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Identity-Status: Confirmed May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Is-Admin-Project: True May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Domain-Id: default May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Domain-Name: Default May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Name: admin May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Role: reader,member,admin May 16 15:07:51.499115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Roles: reader,member,admin May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_205b1267d8204d608304e6a78a0e361f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Tenant: admin May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Tenant-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Tenant-Name: admin May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User: admin May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Domain-Id: default May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Domain-Name: Default May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Id: efb24a53849544a0bc7346ef2b1d8c20 May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Name: admin May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: method: > May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: exception: Flavor 42 could not be found. May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: action_args: {'id': '42'} May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:07:51.500683 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:51.501792 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:51.510639 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-17b2f562-35bb-40aa-b7e5-e4ecb7c01143 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:07:51.512464 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-17b2f562-35bb-40aa-b7e5-e4ecb7c01143 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013447 May 16 15:07:51.512464 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 16 15:07:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 16 15:07:52.376775 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-7a101681-24cf-44eb-94c2-b9fcc7ccb1b7 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:52.377831 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-7a101681-24cf-44eb-94c2-b9fcc7ccb1b7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 16 15:07:52.378271 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:07:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:52.563834 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-e28c89e8-664b-4fac-8418-bb3900c9f469 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:52.568976 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.wsgi [None req-e28c89e8-664b-4fac-8418-bb3900c9f469 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-e28c89e8-664b-4fac-8418-bb3900c9f469 admin admin] Request method failure captured: May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Accept: application/json May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Accept-Encoding: gzip, deflate May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Connection: keep-alive May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Content-Length: 0 May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Host: 10.222.0.44 May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Openstack-Api-Version: compute 2.90 May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Openstack-System-Scope: None May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: User-Agent: python-novaclient May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Auth-Token: gAAAAABigmjIZ_ulPMd6XFbae4dur2-YfVa1Sxzrp6PAFUeZ0EvnXgptda_FQguIy4RfQIC1Uy8H2OjLv_enqqFDudlEoIs2wHUk82-dqYPXx5DB2MLVpNr3fdTCy-pnxU1S-8-gm4q0-vT2CrmDqHCLWZr_EyEQkij1tdfTD35MBBJLWNl7m00 May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Domain-Id: None May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Domain-Name: None May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Identity-Status: Confirmed May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Is-Admin-Project: True May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Domain-Id: default May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Domain-Name: Default May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Name: admin May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Role: reader,member,admin May 16 15:07:52.570490 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Roles: reader,member,admin May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_205b1267d8204d608304e6a78a0e361f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Tenant: admin May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Tenant-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Tenant-Name: admin May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User: admin May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Domain-Id: default May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Domain-Name: Default May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Id: efb24a53849544a0bc7346ef2b1d8c20 May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Name: admin May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: method: > May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: exception: Flavor 84 could not be found. May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: action_args: {'id': '84'} May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:07:52.571986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:52.572827 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:52.573927 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-e28c89e8-664b-4fac-8418-bb3900c9f469 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:07:52.575011 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-e28c89e8-664b-4fac-8418-bb3900c9f469 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058457 May 16 15:07:52.575011 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 16 15:07:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:07:52.581437 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-2296be5e-5cf9-4e88-9533-1f16dfc78e5b admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:52.594693 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-2296be5e-5cf9-4e88-9533-1f16dfc78e5b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016747 May 16 15:07:52.595153 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 16 15:07:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:07:52.604399 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-604e3c03-91a1-4c44-a17f-9564abe3b3f8 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:52.617986 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-604e3c03-91a1-4c44-a17f-9564abe3b3f8 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017018 May 16 15:07:52.618532 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 16 15:07:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:07:52.627746 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-6279fa98-edf9-4fe3-a96d-bbfec5b20db4 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:52.632761 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.wsgi [None req-6279fa98-edf9-4fe3-a96d-bbfec5b20db4 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-6279fa98-edf9-4fe3-a96d-bbfec5b20db4 admin admin] Request method failure captured: May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Accept: application/json May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Accept-Encoding: gzip, deflate May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Connection: keep-alive May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Content-Length: 0 May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Host: 10.222.0.44 May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Openstack-Api-Version: compute 2.90 May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Openstack-System-Scope: None May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: User-Agent: python-novaclient May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Auth-Token: gAAAAABigmjIZ_ulPMd6XFbae4dur2-YfVa1Sxzrp6PAFUeZ0EvnXgptda_FQguIy4RfQIC1Uy8H2OjLv_enqqFDudlEoIs2wHUk82-dqYPXx5DB2MLVpNr3fdTCy-pnxU1S-8-gm4q0-vT2CrmDqHCLWZr_EyEQkij1tdfTD35MBBJLWNl7m00 May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Domain-Id: None May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Domain-Name: None May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Identity-Status: Confirmed May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Is-Admin-Project: True May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Domain-Id: default May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Domain-Name: Default May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Name: admin May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Role: reader,member,admin May 16 15:07:52.634284 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Roles: reader,member,admin May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_205b1267d8204d608304e6a78a0e361f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Tenant: admin May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Tenant-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Tenant-Name: admin May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User: admin May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Domain-Id: default May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Domain-Name: Default May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Id: efb24a53849544a0bc7346ef2b1d8c20 May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Name: admin May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: method: > May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: exception: Flavor 84 could not be found. May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: action_args: {'id': '84'} May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:07:52.635813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:52.636736 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:52.638001 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-6279fa98-edf9-4fe3-a96d-bbfec5b20db4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:07:52.639358 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-6279fa98-edf9-4fe3-a96d-bbfec5b20db4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011277 May 16 15:07:52.639358 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 16 15:07:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:07:53.513590 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-604e3c03-91a1-4c44-a17f-9564abe3b3f8 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:53.514615 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-604e3c03-91a1-4c44-a17f-9564abe3b3f8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 16 15:07:53.515015 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:07:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:53.700398 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-d51b7ba2-4439-42bc-a2f9-3ea87decf84c admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:53.705959 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.wsgi [None req-d51b7ba2-4439-42bc-a2f9-3ea87decf84c admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-d51b7ba2-4439-42bc-a2f9-3ea87decf84c admin admin] Request method failure captured: May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Accept: application/json May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Accept-Encoding: gzip, deflate May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Connection: keep-alive May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Content-Length: 0 May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Host: 10.222.0.44 May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Openstack-Api-Version: compute 2.90 May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Openstack-System-Scope: None May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: User-Agent: python-novaclient May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Auth-Token: gAAAAABigmjJVfKteU31ReCMVjxJ4f8DdcdUQ1yVT54ME6UA1kVSC7LDKVCII7dnp1DOBaZPJcWvzKIq_xV4Pu7kPLoSyZFLW3jL5Apm6Fp-ePRHon5ThIGErM17Pu4YhpMQQMxYrwAyZaOkHXbNthuOAtu0TITXk7CCxctOwzk3IHHmwi5cqr0 May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Domain-Id: None May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Domain-Name: None May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Identity-Status: Confirmed May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Is-Admin-Project: True May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Domain-Id: default May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Domain-Name: Default May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Project-Name: admin May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Role: reader,member,admin May 16 15:07:53.707466 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Roles: reader,member,admin May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_205b1267d8204d608304e6a78a0e361f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Tenant: admin May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Tenant-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-Tenant-Name: admin May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User: admin May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Domain-Id: default May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Domain-Name: Default May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Id: efb24a53849544a0bc7346ef2b1d8c20 May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: X-User-Name: admin May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: method: > May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: exception: Flavor 451 could not be found. May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: action_args: {'id': '451'} May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:07:53.709010 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:53.709997 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: ERROR nova.api.openstack.wsgi May 16 15:07:53.711199 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-d51b7ba2-4439-42bc-a2f9-3ea87decf84c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:07:53.712244 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-d51b7ba2-4439-42bc-a2f9-3ea87decf84c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058698 May 16 15:07:53.712244 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 16 15:07:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:07:53.718840 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-de3158cb-a371-4eba-abff-f3250011fba0 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:53.732825 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-de3158cb-a371-4eba-abff-f3250011fba0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017964 May 16 15:07:53.733272 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 16 15:07:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:07:53.742081 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:53.755348 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016593 May 16 15:07:53.755896 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 16 15:07:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:07:53.766087 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-76022aab-06d7-4ccd-9bb5-6b660cedb180 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:53.771546 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.wsgi [None req-76022aab-06d7-4ccd-9bb5-6b660cedb180 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-76022aab-06d7-4ccd-9bb5-6b660cedb180 admin admin] Request method failure captured: May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Accept: application/json May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Accept-Encoding: gzip, deflate May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Connection: keep-alive May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Content-Length: 0 May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Host: 10.222.0.44 May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Openstack-Api-Version: compute 2.90 May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Openstack-System-Scope: None May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: User-Agent: python-novaclient May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Auth-Token: gAAAAABigmjJVfKteU31ReCMVjxJ4f8DdcdUQ1yVT54ME6UA1kVSC7LDKVCII7dnp1DOBaZPJcWvzKIq_xV4Pu7kPLoSyZFLW3jL5Apm6Fp-ePRHon5ThIGErM17Pu4YhpMQQMxYrwAyZaOkHXbNthuOAtu0TITXk7CCxctOwzk3IHHmwi5cqr0 May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Domain-Id: None May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Domain-Name: None May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Identity-Status: Confirmed May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Is-Admin-Project: True May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Domain-Id: default May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Domain-Name: Default May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Project-Name: admin May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Role: reader,member,admin May 16 15:07:53.773017 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Roles: reader,member,admin May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/205b1267d8204d608304e6a78a0e361f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_205b1267d8204d608304e6a78a0e361f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Tenant: admin May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Tenant-Id: 205b1267d8204d608304e6a78a0e361f May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-Tenant-Name: admin May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User: admin May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Domain-Id: default May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Domain-Name: Default May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Id: efb24a53849544a0bc7346ef2b1d8c20 May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: X-User-Name: admin May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: method: > May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: exception: Flavor 451 could not be found. May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: action_args: {'id': '451'} May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:07:53.774645 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:53.775874 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 16 15:07:53.777022 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-76022aab-06d7-4ccd-9bb5-6b660cedb180 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:07:53.778622 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-76022aab-06d7-4ccd-9bb5-6b660cedb180 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012095 May 16 15:07:53.778622 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 16 15:07:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:07:54.651292 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:54.652295 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 16 15:07:54.652686 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:07:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:54.837402 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-e01419a1-b190-4758-9417-07b64782e82d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:54.942856 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-e01419a1-b190-4758-9417-07b64782e82d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.154981 May 16 15:07:54.943373 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 16 15:07:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:55.827517 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:55.828518 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 May 16 15:07:55.828913 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:56.016072 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-880f2888-58da-4f1a-a535-5a5ea0e28044 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:56.096884 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-880f2888-58da-4f1a-a535-5a5ea0e28044 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.131908 May 16 15:07:56.097437 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 16 15:07:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:56.979932 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:56.980936 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 16 15:07:56.981341 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:07:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:57.165863 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-552c7366-dc3e-43bf-8d10-b774049f8b93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:57.235189 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-552c7366-dc3e-43bf-8d10-b774049f8b93 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.119108 May 16 15:07:57.235664 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 16 15:07:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:58.124116 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:58.125147 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 16 15:07:58.125541 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:07:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:58.310822 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-e23d0ec7-a1de-41e2-9da7-5c73ed58473d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:07:58.407642 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-e23d0ec7-a1de-41e2-9da7-5c73ed58473d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.147753 May 16 15:07:58.408115 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 16 15:07:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:07:59.293069 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:59.294089 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 May 16 15:07:59.294491 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:07:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:07:59.483111 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-2d2ba397-fad4-4931-8aac-717bf0ab35b8 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:07:59.501805 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-2d2ba397-fad4-4931-8aac-717bf0ab35b8 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068949 May 16 15:07:59.502355 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Mon May 16 15:07:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:09:01.302315 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:01.303313 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-d2ea63a9-4d74-48dd-a47d-f32f9b71ee5e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 16 15:09:01.303704 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 16 15:09:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:09:01.359921 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-fe213c9b-9450-4425-970b-0f30588e963d admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:01.379049 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-fe213c9b-9450-4425-970b-0f30588e963d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069602 May 16 15:09:01.391191 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 16 15:09:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:09:01.401788 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-cf42c356-99b0-41fd-9b65-99241447f860 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:01.409953 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-cf42c356-99b0-41fd-9b65-99241447f860 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012354 May 16 15:09:01.410494 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Mon May 16 15:09:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:09:01.421338 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-fb419c65-3b76-42bf-8a1b-0143af5b4e43 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:01.428918 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-fb419c65-3b76-42bf-8a1b-0143af5b4e43 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011160 May 16 15:09:01.429426 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Mon May 16 15:09:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:09:01.440194 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-4687a1ab-444f-482f-b2ae-7180ace532c0 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:01.451606 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-4687a1ab-444f-482f-b2ae-7180ace532c0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010694 May 16 15:09:01.451606 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Mon May 16 15:09:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:09:01.459270 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-dc2809da-23e6-496f-a910-f6ee049a8a5d admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:09:01.466749 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-dc2809da-23e6-496f-a910-f6ee049a8a5d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010975 May 16 15:09:01.467263 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Mon May 16 15:09:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:13:05.214274 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-4687a1ab-444f-482f-b2ae-7180ace532c0 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:05.215308 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-4687a1ab-444f-482f-b2ae-7180ace532c0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 May 16 15:13:05.215696 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:13:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:05.475587 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-a959039b-c418-4697-a414-05a7243b8ac4 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:05.476780 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:05.476780 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 16 15:13:05.478002 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-a959039b-c418-4697-a414-05a7243b8ac4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:05.478469 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-a959039b-c418-4697-a414-05a7243b8ac4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:05.479912 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-a959039b-c418-4697-a414-05a7243b8ac4 admin admin] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:05.480339 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-a959039b-c418-4697-a414-05a7243b8ac4 admin admin] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:05.513255 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-a959039b-c418-4697-a414-05a7243b8ac4 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.145405 May 16 15:13:05.513809 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 16 15:13:05 2022] GET /compute/v2.1/os-services => generated 794 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:13:06.417470 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-4687a1ab-444f-482f-b2ae-7180ace532c0 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:06.418505 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-4687a1ab-444f-482f-b2ae-7180ace532c0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001932 May 16 15:13:06.418901 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:13:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:06.606729 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-af1f3379-2251-453e-9e54-44ccb8115d7d admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:06.607900 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:06.607900 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 16 15:13:06.609077 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-af1f3379-2251-453e-9e54-44ccb8115d7d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:06.609519 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-af1f3379-2251-453e-9e54-44ccb8115d7d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:06.610366 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-af1f3379-2251-453e-9e54-44ccb8115d7d admin admin] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:06.610795 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-af1f3379-2251-453e-9e54-44ccb8115d7d admin admin] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:06.630005 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-af1f3379-2251-453e-9e54-44ccb8115d7d admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.073875 May 16 15:13:06.630527 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 16 15:13:06 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:13:17.921054 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-4687a1ab-444f-482f-b2ae-7180ace532c0 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:17.922737 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-4687a1ab-444f-482f-b2ae-7180ace532c0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 16 15:13:17.922737 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:13:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:18.112412 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-1239d355-8c3a-4c21-a681-bb7625fc46fe admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:18.113569 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:18.113569 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 16 15:13:18.114761 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-1239d355-8c3a-4c21-a681-bb7625fc46fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:18.115199 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-1239d355-8c3a-4c21-a681-bb7625fc46fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:18.115972 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-1239d355-8c3a-4c21-a681-bb7625fc46fe admin admin] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:18.116391 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-1239d355-8c3a-4c21-a681-bb7625fc46fe admin admin] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:18.141113 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-1239d355-8c3a-4c21-a681-bb7625fc46fe admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078801 May 16 15:13:18.141614 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 16 15:13:18 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:13:19.040813 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: DEBUG nova.api.openstack.wsgi [None req-4687a1ab-444f-482f-b2ae-7180ace532c0 admin admin] Calling method '>' {{(pid=103255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:19.041820 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: INFO nova.api.openstack.requestlog [None req-4687a1ab-444f-482f-b2ae-7180ace532c0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 16 15:13:19.042290 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: [pid: 103255|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 16 15:13:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:19.232465 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-81cf167f-8cd7-435e-88fb-e53f735f7066 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:19.233615 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:19.233615 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 16 15:13:19.234846 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-81cf167f-8cd7-435e-88fb-e53f735f7066 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:19.235280 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-81cf167f-8cd7-435e-88fb-e53f735f7066 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:19.236052 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-81cf167f-8cd7-435e-88fb-e53f735f7066 admin admin] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:13:19.236473 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-81cf167f-8cd7-435e-88fb-e53f735f7066 admin admin] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:13:19.257748 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-81cf167f-8cd7-435e-88fb-e53f735f7066 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.075630 May 16 15:13:19.258257 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 16 15:13:19 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:14:20.087149 dv-cinder-795785-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 16 15:14:20.094079 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: Mon May 16 15:14:20 2022 - graceful shutdown triggered... May 16 15:14:20.094710 dv-cinder-795785-10-iscsi devstack@n-api.service[103255]: Gracefully killing worker 1 (pid: 103255)... May 16 15:14:20.095088 dv-cinder-795785-10-iscsi devstack@n-api.service[103256]: Gracefully killing worker 2 (pid: 103256)... May 16 15:14:21.088802 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: worker 1 buried after 1 seconds May 16 15:14:21.088954 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: worker 2 buried after 1 seconds May 16 15:14:21.088954 dv-cinder-795785-10-iscsi devstack@n-api.service[103254]: goodbye to uWSGI. May 16 15:14:21.090407 dv-cinder-795785-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 16 15:14:21.090983 dv-cinder-795785-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 16 15:14:21.093974 dv-cinder-795785-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 15:14:21.108234 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 15:14:21.126720 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 15:14:21 2022] *** May 16 15:14:21.126720 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 15:14:21.126720 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 15:14:21.126720 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: nodename: dv-cinder-795785-10-iscsi May 16 15:14:21.126720 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: machine: x86_64 May 16 15:14:21.126720 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: clock source: unix May 16 15:14:21.126720 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: pcre jit disabled May 16 15:14:21.126720 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: detected number of CPU cores: 4 May 16 15:14:21.126720 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: current working directory: / May 16 15:14:21.126720 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: detected binary path: /usr/bin/uwsgi-core May 16 15:14:21.127580 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: your processes number limit is 47680 May 16 15:14:21.127580 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: your memory page size is 4096 bytes May 16 15:14:21.127580 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: detected max file descriptor number: 2048 May 16 15:14:21.127580 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: lock engine: pthread robust mutexes May 16 15:14:21.127580 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: thunder lock: enabled May 16 15:14:21.127580 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 15:14:21.127580 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 15:14:21.181839 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: Python main interpreter initialized at 0x560d80f769c0 May 16 15:14:21.181839 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: python threads support enabled May 16 15:14:21.181839 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: your server socket listen backlog is limited to 100 connections May 16 15:14:21.181839 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: your mercy for graceful operations on workers is 90 seconds May 16 15:14:21.182365 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: mapped 403077 bytes (393 KB) for 2 cores May 16 15:14:21.182365 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: *** Operational MODE: preforking *** May 16 15:14:21.182601 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: *** uWSGI is running in multiple interpreter mode *** May 16 15:14:21.182601 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: spawned uWSGI master process (pid: 117628) May 16 15:14:21.182810 dv-cinder-795785-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 15:14:21.183660 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: spawned uWSGI worker 1 (pid: 117648, cores: 1) May 16 15:14:21.183779 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: spawned uWSGI worker 2 (pid: 117649, cores: 1) May 16 15:14:21.183900 dv-cinder-795785-10-iscsi devstack@n-api.service[117628]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 15:14:22.394830 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:14:22.401037 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:14:23.184273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:14:23.184273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: from cryptography.utils import int_from_bytes May 16 15:14:23.184593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:14:23.184593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: from cryptography.utils import int_from_bytes May 16 15:14:23.196147 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:14:23.196147 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: from cryptography.utils import int_from_bytes May 16 15:14:23.196488 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:14:23.196488 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: from cryptography.utils import int_from_bytes May 16 15:14:25.620107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:14:25.620649 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:14:25.620889 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:14:25.621245 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:14:25.621503 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:14:25.621893 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.622246 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.622582 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.622916 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.623234 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.623552 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.623875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.624198 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.624526 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.624842 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.625102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.625427 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-10-iscsi {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.625752 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.626078 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.626394 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.626714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.627023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.627344 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.627652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.628269 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.628705 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.629021 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.629337 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.629679 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.629997 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.630341 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.630665 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.630978 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.631305 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.632152 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.632554 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-10-iscsi {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.632879 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.633201 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.633519 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.633938 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.634280 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.634593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.635036 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.635368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.635682 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.636020 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.636338 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.636658 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.636983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.637346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.637767 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.638261 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.638748 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.639123 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.639440 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.639698 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.640020 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.640346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.640675 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.641147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.641534 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.641910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.642265 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.642598 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.642919 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.643235 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.643550 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.643944 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.644421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.644884 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.645199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.645513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.645841 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.646198 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.646545 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.646962 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.648018 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.648547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.648813 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.649156 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.649266 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:14:25.649671 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:14:25.649756 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.649837 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.650021 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:14:25.650265 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.650367 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:14:25.650449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.650627 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:14:25.650778 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.651005 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.651111 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.651339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.651447 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.651665 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.651761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.651988 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.652098 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.652316 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.652418 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.652628 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.652746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.652902 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.653011 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.653195 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.653302 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.653507 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.653616 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.653901 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.654120 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.654307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.654458 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.654458 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.654735 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-10-iscsi {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.654890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.655041 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.655188 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.655339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.655480 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.655619 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.655767 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.655914 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.656081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.656247 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.656402 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.656552 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.656702 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.656856 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.657055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.657209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.657393 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.657575 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.657725 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.657873 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.658014 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.658193 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.658344 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.658505 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.658687 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.658835 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.659144 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.659319 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.659471 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.659621 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.659763 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.659926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.660085 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.660240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.660423 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.660575 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.660726 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.660873 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.661087 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.661238 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-10-iscsi {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.661389 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.661530 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.661683 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.661823 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.661961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.662135 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.662299 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.662441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.662595 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.662736 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.662883 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.663055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.663215 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.663395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.663575 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.663799 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.663946 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.664086 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.664267 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.664415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.664566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.664804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.664982 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.665264 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.665429 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.665594 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.665737 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.665878 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.666018 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.666244 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.666387 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.666550 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.666707 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.666847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.666987 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.667155 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.667305 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.667454 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.667655 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.667889 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.668054 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.668219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.668376 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.668526 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.668673 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.668815 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.668962 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.669152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.669304 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.669483 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.669595 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.669817 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.669924 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.670103 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.670288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.670432 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.670574 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.670720 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.670861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.671012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.671159 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.671300 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.671456 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.671604 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.671744 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.671898 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.672050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.672198 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.672338 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.672485 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.672632 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.672792 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.672944 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.673085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.673241 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.673389 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.673535 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.673690 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.673865 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.674015 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.674212 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.674354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.674505 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.674654 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.674794 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.674964 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.675130 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.675372 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.675530 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.675671 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.675821 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.675968 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.676121 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.676263 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.676417 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.676559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.676699 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.676874 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.677030 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.677200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.677376 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.677518 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.677658 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.677829 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.677985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.678167 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.678318 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.678502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.678658 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.678830 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.678978 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.679151 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.679399 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.679643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.679800 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.679953 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.680101 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.680265 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.680408 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.680548 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.680701 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.680848 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.680999 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.681155 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.681296 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.681448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.681588 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.681727 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.681879 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.682019 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.682205 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.682360 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.682502 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.682650 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.682799 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.682946 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.683096 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.683244 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.683401 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.683543 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.683691 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.683839 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.683979 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.684118 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.684268 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.684408 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.684562 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.684711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.684852 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.684999 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.685146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.685300 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.685450 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.685684 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.685832 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.685972 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.686143 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.686305 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.686447 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.686602 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.686756 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.686903 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.687119 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.687268 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.687419 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.687559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.687706 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.687846 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.687998 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.687998 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.688272 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.688272 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.688543 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.688543 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.688848 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.688993 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.689132 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.689320 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.689559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.689818 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.689977 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.690152 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.690297 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.690438 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.690577 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.690577 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.690862 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.691001 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.691148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.691309 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.691457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.691607 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.691747 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.691896 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.692036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.692201 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.692360 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.692526 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.692682 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.692857 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.693021 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.693163 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.693322 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.693484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.693639 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.693823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.694492 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.694701 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.694863 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.695012 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.695161 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.695309 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.695472 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.695649 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:14:25.695800 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.695965 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.696108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.696249 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.696387 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.696563 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.696718 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.696868 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.697008 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.697156 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.697304 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.697454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.697639 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.697804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.697945 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.698154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.698317 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.698473 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.698637 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.698785 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.698955 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.699100 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.699251 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.699392 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.699557 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.699794 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.700039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.700451 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.700451 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.700741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.700882 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.701022 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.701168 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.701308 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.701458 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.701606 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.701752 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.701892 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.702038 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.702232 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.702384 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.702531 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.702678 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.702822 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.702962 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.703122 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.703266 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.703415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.703562 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.703709 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.703876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.704042 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.704192 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.704332 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.704496 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.704703 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.704881 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.705033 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.705175 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.705364 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.705523 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.705671 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.705819 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.705973 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.706177 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.706323 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.706462 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.706614 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.706763 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.706956 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.707114 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.707277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.707433 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.707582 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.707737 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.707905 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.708061 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.708221 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.708362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.708510 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.708703 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.708901 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.709074 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.709215 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.709361 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.709503 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.710397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.710579 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.710712 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.711022 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.711130 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.711339 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.711598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.711701 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.711966 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.712123 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.712289 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.712605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.712697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.712931 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.713192 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.713284 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.713559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.713786 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.713887 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.714196 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.714347 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.714532 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.714886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.715033 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.715214 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.715506 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.715764 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.715937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.716133 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.716409 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.716541 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.716752 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.716883 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.717063 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.717197 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.717378 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.717525 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.717736 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.717874 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.718023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.718301 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.718419 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.718538 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.718649 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.718758 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.718939 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.719137 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.719263 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.719376 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.719527 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.719649 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.719832 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.719967 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.720266 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.720386 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.720579 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.720704 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.720894 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.721032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.721206 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.721332 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.721530 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.721649 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.721843 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.721971 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.722173 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.722294 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.722483 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.722613 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.722807 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.722935 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.723120 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.723240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.723433 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.723552 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.723739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.723884 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.724043 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.724162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.724359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.724502 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.724684 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.724801 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.724989 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.725127 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.725335 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.725489 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.725739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.725942 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.726097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.726215 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.726339 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.726466 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.726597 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.726710 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.726903 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.727023 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.727228 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.727362 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.727561 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.727687 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.727830 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.728037 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.728153 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.728279 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.728441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.728585 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.728754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.728874 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.729089 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.729236 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.729373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.729499 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.729680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.729817 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.729989 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.730139 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.730325 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.730467 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.730633 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.730754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.730948 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.731077 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.731260 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.731520 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.731647 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.731844 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.731989 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.732173 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.732298 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.732487 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.732617 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.732808 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.732946 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.733131 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.733263 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.733456 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.733575 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.733788 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.733918 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.734146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.734273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.734473 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.734800 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.734993 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.735157 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.735317 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.735470 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.735613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.735900 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.736133 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.736283 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.736441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.736600 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.736751 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.736902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.737046 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.737199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.737349 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.737506 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.737708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.737855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.737998 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.738340 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.738486 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.738649 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.738795 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.738938 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.739081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.739319 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.739491 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.739491 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.739771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.739914 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.740056 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.740208 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.740360 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.740510 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.740659 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.740817 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.740960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.741102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.741258 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.741422 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.741656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.741817 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.741970 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.742147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.742315 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.742460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.742612 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.742755 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.742903 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.743059 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.743212 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.743372 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.743515 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.743664 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.743808 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.743965 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.744108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.744268 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.744655 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.744808 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.744951 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.745113 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.745258 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.745402 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.745554 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.745697 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.745982 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.746238 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.746391 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.746535 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.746677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.746819 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.746975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.747127 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.747280 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.747422 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.747573 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.747733 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.747956 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.748108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.748252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.748506 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.748664 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.748816 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.748969 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.749113 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.749263 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.749497 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.749656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.749807 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.749807 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.750212 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.750364 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.750507 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.750659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.750816 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.750967 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.751109 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.751250 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.751399 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.751548 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.751792 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.751972 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.752130 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.752281 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.752438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.752610 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.752774 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.752925 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.753075 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.753232 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.753382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.753538 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.753698 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.753850 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.754016 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.754191 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.754371 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.754781 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.754957 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.755120 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.755279 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.755436 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.755595 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.755760 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.756051 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.756241 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.756962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.757136 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.757287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.757448 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.757598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.757756 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.757916 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.758116 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.758277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.758440 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.758704 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.758873 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.759026 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.759176 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.759351 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.759531 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.759763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.759927 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.760089 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.760247 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.760408 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.760559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.760559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.760860 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.761017 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.761169 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.761332 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.761495 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.761659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.761890 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.762072 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.762243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.762406 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.762557 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.762714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.762872 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.763030 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.763196 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.763354 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.763515 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.763666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.763816 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.763974 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.764138 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.764289 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.764438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.764615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.765005 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.765167 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.765167 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.765472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.765631 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.765800 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.765958 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.766255 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.766452 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.766674 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.766839 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.766999 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.767203 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.767372 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.767545 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.767697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.767847 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.767997 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.768165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.768330 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.768483 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.768645 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.768909 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.769079 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.769232 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.769397 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.769557 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.769734 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.769966 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.770155 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.770322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.770491 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.770643 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.770801 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.770961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.771120 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.771278 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.771428 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.771586 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.771737 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.771919 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.772761 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.772936 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.773107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.773265 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.773423 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.773584 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.773736 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.773886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.774044 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.774233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.774436 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.774589 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.774740 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.775145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.775315 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.775481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.775642 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.775795 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.775945 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.776095 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.776392 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.776558 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.776802 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.776972 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.777133 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.777292 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.777450 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.777601 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.777771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.777933 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.777933 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.778277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.778435 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.778596 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.778754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.778924 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.779174 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.779331 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.779331 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.779625 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.779796 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.779976 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.780200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.780359 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.780518 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.780679 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.780839 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.780990 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.781149 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.781307 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.781457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.781615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.781765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.781932 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.782123 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.782347 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.782585 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.782739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.782897 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.783055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.783207 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.783358 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.783522 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.783680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.783838 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.783988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.784149 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.784300 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.784466 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.784625 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.784782 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.784949 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.785342 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.785511 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.785672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.785824 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.785982 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.786196 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.786502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.786690 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.786925 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.787083 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.787339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.787497 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.787656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.787857 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.788011 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.788162 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.788313 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.788464 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.788622 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.788783 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.788953 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.789105 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.789255 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.789518 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.789686 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.789847 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.790008 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.790211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.790443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.790600 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.790826 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.790988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.791159 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.791318 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.791479 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.791638 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.791798 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.791956 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.792114 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.792272 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.792507 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.792666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.792834 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.792994 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.793152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.793314 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.793471 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.793623 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.793783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.793942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.794123 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.794288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.794439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.794603 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.794763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.794763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.795056 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.795476 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.795658 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.795827 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.795987 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.796138 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.796297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.796596 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.796767 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.796956 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.797177 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.797333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.797484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.797634 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.797796 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.797961 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.798130 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.798287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.798449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.798600 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.798764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.798916 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.799074 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.799224 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.799374 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.799374 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.799792 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.799962 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.800113 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.800271 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.800441 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.800662 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.800835 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.800988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.801138 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.801295 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.801446 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.801603 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.801768 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.801927 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.802199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.802370 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.802577 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.802828 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.802987 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.803149 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.803300 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.803483 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.803641 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.803806 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.803965 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.804124 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.804633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.804807 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.804959 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.805120 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.805303 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.805710 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.805883 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.806044 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.806223 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.806387 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.806683 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.806846 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.807008 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.807188 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.807433 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.807599 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.807751 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.807902 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.808060 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.808211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.808373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.808533 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.808699 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.808863 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.809022 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.809181 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.809357 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.809510 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.809668 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.809926 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.810118 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.810278 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.810430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.810588 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.810837 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.810998 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.811160 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.811319 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.811478 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.811648 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.811799 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.811950 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.812116 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.812268 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.812427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.812580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.812730 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.812969 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.813137 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.813297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.813456 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.813609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.813778 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.813943 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.814129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.814299 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.814299 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.814602 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.814761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.814995 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.814995 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.815305 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.815305 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.815852 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.815852 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.816170 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.816323 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.816475 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.816625 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.816942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.817095 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.817254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.817432 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.817657 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.817657 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.817969 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.818159 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.818334 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.818494 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.818653 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.818813 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.819495 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.819677 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.819839 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.820110 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.820269 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.820429 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.820580 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.820739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.820992 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.821172 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.821333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.821536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.821701 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.821866 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.822026 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.822202 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.822357 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.822357 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.822665 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.822817 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.822993 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.823217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.823394 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.823547 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.823711 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.823869 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.824030 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.824030 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.824324 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.824482 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.824646 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.824804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.824957 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.825369 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.825535 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.825954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.826240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.826407 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.826574 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.826734 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.827036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.827200 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.827354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.827512 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.827691 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.827912 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.828070 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.828241 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.828393 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.828544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.828695 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.828853 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.829004 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.829164 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.829316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.829474 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.829635 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.829797 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.829971 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.830248 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.830410 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.830569 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.830720 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.830871 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.831128 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.831290 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.831451 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.831610 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.831770 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.831936 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.832093 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.832262 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.832415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.832565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.832715 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.832884 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.833035 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.833214 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.833436 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.833601 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.833753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.833913 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.834091 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.834249 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.834422 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.834574 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.835268 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.835432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.835585 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.835746 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.836065 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.836311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.836477 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.836630 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.836788 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.836788 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.837246 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.837398 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.837564 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.837725 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.837894 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.838161 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.838323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.838474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.838637 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.838797 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.838956 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.839114 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.839265 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.839426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.839595 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.839755 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.839906 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.840064 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.840234 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.840492 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.840661 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.840821 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.840981 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.841161 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.841388 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.841557 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.841729 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.841889 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.842040 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.842219 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.842370 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.842535 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.842695 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.842854 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.843014 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.843165 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.843323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.843570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.843748 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.843900 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.844052 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.844210 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.844371 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.844522 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.844679 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.844838 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.844990 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.845147 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.845307 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.845458 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.845609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.845779 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.845930 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.846274 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.846557 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.846726 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.846878 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.847193 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.847354 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.847521 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.847673 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.847831 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.847990 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.848228 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.848396 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.848623 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.848777 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.848927 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.849084 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.849236 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.849393 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.849554 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.849713 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.849870 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.850029 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.850204 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.850396 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.850693 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.850855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.851005 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.851155 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.851314 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.851575 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.851742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.851914 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.852075 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.852234 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.852395 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.852561 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.852733 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.852884 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.853034 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.853191 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.853341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.853505 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.853505 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.853905 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.854122 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.854360 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.854531 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.854717 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.855401 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.855586 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.855757 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.855910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.856068 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.856391 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.856574 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.856819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.856979 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.857157 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.857470 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.857625 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.857785 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.857937 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858117 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858353 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858531 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858687 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858837 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.858995 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859304 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859469 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859627 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859779 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.859938 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860089 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860268 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860586 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860586 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.860889 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861047 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861214 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861214 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861707 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.861868 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862029 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862258 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862591 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862749 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.862901 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.863052 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.863210 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.863376 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.863535 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.863694 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.863942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.864100 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.864260 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.864429 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.864580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.864731 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.865416 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.865593 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.865768 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.865987 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.866197 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.866372 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.866682 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.866852 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.867014 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.867180 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.867605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.867773 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.867932 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868093 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868253 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868658 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868817 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.868977 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869139 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869290 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869611 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.869927 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870117 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870280 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870731 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870848 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.870938 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871193 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871294 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871822 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.871948 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872061 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872173 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872301 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872744 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872854 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.872988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873102 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873212 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873451 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873693 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873813 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.873946 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874161 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874402 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874523 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874636 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874857 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.874975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875100 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875220 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875332 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875563 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875682 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875808 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.875921 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876041 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876272 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876392 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876534 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.876827 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877074 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877314 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.877921 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878043 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878194 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878320 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878442 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878627 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878868 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.878988 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879100 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879286 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879409 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879530 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879651 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.879883 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880008 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880122 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880242 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880354 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880466 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880707 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880819 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.880938 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.881051 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.881161 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.881281 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.881394 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882300 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882433 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882546 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882658 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882780 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.882901 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883013 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883132 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883245 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883602 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883722 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883843 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.883956 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884077 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884283 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884402 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.884626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885061 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885173 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885284 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885394 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885394 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885619 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885730 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.885970 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.886112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.886251 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.886366 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.895955 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.896132 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.896273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.896412 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.896529 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.896642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.896755 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.896874 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.896988 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.897734 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.897901 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.898106 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.898260 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.898393 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.898514 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.898640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.898754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.898865 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.898983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.899102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.899221 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.899345 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.899345 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.899567 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.902235 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.902403 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.902566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.902707 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.902848 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.902981 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.903111 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.903250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.903401 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.903534 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.903664 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.903794 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.903932 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.904063 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.904203 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.904343 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.904491 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.904620 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.904751 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.904885 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905132 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905245 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905475 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905596 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905716 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.905939 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906101 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906242 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.906505 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908510 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908648 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908781 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.908909 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909034 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909157 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909271 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909383 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909625 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909760 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.909933 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:14:25.910072 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910072 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910072 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910072 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910072 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910072 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910072 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910072 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.910926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.912599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.913503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.914379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.915378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.916359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.917849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.919570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920558 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920558 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920558 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920558 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920558 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.920558 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921303 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_db.sqlalchemy.engines [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:25.921439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.921439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923091 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923091 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923091 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923091 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923091 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923091 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923091 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.923091 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924065 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924065 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924065 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924065 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:14:25.924065 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:14:25.947928 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_db.sqlalchemy.engines [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:25.979043 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.context [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1579528c-849f-42a7-b29b-4c61d7971040(cell1) {{(pid=117649) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:14:25.983442 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:14:25.985029 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:14:25.985856 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:14:25.987874 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:14:25.999532 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_db.sqlalchemy.engines [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.001778 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_db.sqlalchemy.engines [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.014422 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.context [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1579528c-849f-42a7-b29b-4c61d7971040(cell1) {{(pid=117648) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:14:26.018840 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:14:26.020619 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:14:26.021450 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:14:26.024000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:14:26.035759 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_db.sqlalchemy.engines [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.038078 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_db.sqlalchemy.engines [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.164175 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_db.sqlalchemy.engines [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.199709 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_db.sqlalchemy.engines [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:14:26.482135 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: WARNING keystonemiddleware.auth_token [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:14:26.489650 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: WARNING keystonemiddleware.auth_token [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:14:26.521413 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: WARNING keystonemiddleware.auth_token [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:14:26.529462 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: WARNING keystonemiddleware.auth_token [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:14:26.838139 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: WARNING keystonemiddleware.auth_token [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:14:26.844437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: WARNING keystonemiddleware.auth_token [None req-930e8d09-0688-4322-80a2-49f3147dd848 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:14:26.849599 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560d80f769c0 pid: 117649 (default app) May 16 15:14:26.875933 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: WARNING keystonemiddleware.auth_token [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:14:26.882294 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: WARNING keystonemiddleware.auth_token [None req-916843c1-cf25-47f3-956d-e871718bd11c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:14:26.887915 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560d80f769c0 pid: 117648 (default app) May 16 15:15:14.694280 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1006560344", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "networks": [{"uuid": "f79a4d11-7fc6-40e0-8a7d-fa2d8875e4ab"}]}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:15.504270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] validate_networks() for [('f79a4d11-7fc6-40e0-8a7d-fa2d8875e4ab', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:15:18.671809 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:15:18.672994 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:15:18.674244 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:15:18.674786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:15:18.675358 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:15:18.706535 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:18.706992 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:18.712982 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:18.713434 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:18.773573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Getting quotas for project bb76045fec614358bd2bb89018436943. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:18.782803 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Getting quotas for user 22de22e8d5964f29b577af216eb3cdd9 and project bb76045fec614358bd2bb89018436943. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:18.798974 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:15:18.803051 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:15:18.989749 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-85ac2a0d-7dd0-4f1e-b887-aa2146c824cf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.416502 May 16 15:15:18.990424 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:15:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 5419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:15:19.343682 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8c0cdfa3-4501-4779-a9bb-a27ad8c694d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:19.345378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8c0cdfa3-4501-4779-a9bb-a27ad8c694d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:20.620257 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8c0cdfa3-4501-4779-a9bb-a27ad8c694d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:20.648022 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8c0cdfa3-4501-4779-a9bb-a27ad8c694d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1215 microversion: 2.1 time: 1.649633 May 16 15:15:20.657736 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 1/2] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:18 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1215 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:21.676184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5d7a6d49-b1c1-406f-b7ec-b62b0d3318f5 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:21.677539 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5d7a6d49-b1c1-406f-b7ec-b62b0d3318f5 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:21.972408 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5d7a6d49-b1c1-406f-b7ec-b62b0d3318f5 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:22.005283 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5d7a6d49-b1c1-406f-b7ec-b62b0d3318f5 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1215 microversion: 2.1 time: 0.334048 May 16 15:15:22.005875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:21 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:23.023209 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dca76567-7c1c-47cc-9768-ad339835f9f2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:23.024770 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dca76567-7c1c-47cc-9768-ad339835f9f2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:23.042456 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dca76567-7c1c-47cc-9768-ad339835f9f2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:23.042915 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dca76567-7c1c-47cc-9768-ad339835f9f2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:23.043711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dca76567-7c1c-47cc-9768-ad339835f9f2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:23.044164 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dca76567-7c1c-47cc-9768-ad339835f9f2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:23.370794 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-dca76567-7c1c-47cc-9768-ad339835f9f2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:23.411941 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dca76567-7c1c-47cc-9768-ad339835f9f2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1219 microversion: 2.1 time: 0.392766 May 16 15:15:23.412497 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:23 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1219 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:24.036429 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-145044697", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:24.175481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] validate_networks() for [('8561ad64-1b6b-4f33-82d1-a2d7e72d5b01', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:15:24.286021 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f38f8ee6-8881-4ac5-bfff-b076ab3a0bfe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: .version_select at 0x7fc9ad2f4ca0>, body: {"keypair": {"name": "tempest-keypair-993705601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnCa7302aNDXzN4bP1TrjS0Mnb6h70Sd5GNpat0FPlfY51s1vLbx6GjY7KBYphX8k9ni6vR9ndKjmQoh8PMrhKPxwe25F6VlLmMeapW/GRJMdZPNstKgLP24Qn7AEKZPw=="}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:24.393545 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-f38f8ee6-8881-4ac5-bfff-b076ab3a0bfe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for project d143bc5a616249a7beefc7b27962026b. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:24.406414 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-f38f8ee6-8881-4ac5-bfff-b076ab3a0bfe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for user 44ffd5660baa40a7a3d6918cb5d31e56 and project d143bc5a616249a7beefc7b27962026b. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:24.669978 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f38f8ee6-8881-4ac5-bfff-b076ab3a0bfe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.949888 May 16 15:15:24.671137 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 3/5] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 16 15:15:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:24.681604 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c994f6d4-1101-4a5d-bce4-733ecc5f0aaf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:24.681604 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c994f6d4-1101-4a5d-bce4-733ecc5f0aaf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:24.696847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c994f6d4-1101-4a5d-bce4-733ecc5f0aaf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:24.697796 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c994f6d4-1101-4a5d-bce4-733ecc5f0aaf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:24.698833 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c994f6d4-1101-4a5d-bce4-733ecc5f0aaf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:24.701408 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c994f6d4-1101-4a5d-bce4-733ecc5f0aaf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:24.870636 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c994f6d4-1101-4a5d-bce4-733ecc5f0aaf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:24.880737 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c994f6d4-1101-4a5d-bce4-733ecc5f0aaf tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1275 microversion: 2.1 time: 0.205856 May 16 15:15:24.881976 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 4/6] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:24 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:25.328387 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:15:25.328873 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:15:25.330164 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:15:25.330724 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:15:25.331282 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:15:25.349443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:25.358344 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:25.359785 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:25.366738 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:25.418471 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Getting quotas for project 316917d7a31645bfaac651f81154c18f. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:25.429337 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Getting quotas for user a14795cb97ac44b2a7fc1e2f79b12253 and project 316917d7a31645bfaac651f81154c18f. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:25.442942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:15:25.445877 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:15:25.593627 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-235426bd-7db6-484f-81b3-2eae4dc2e154 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.459143 May 16 15:15:25.594341 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 3/7] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:15:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 15:15:25.637792 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b96232c9-087a-415f-84ec-d18a1d3dc945 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:25.638812 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b96232c9-087a-415f-84ec-d18a1d3dc945 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:25.765683 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b96232c9-087a-415f-84ec-d18a1d3dc945 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:25.773264 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b96232c9-087a-415f-84ec-d18a1d3dc945 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1221 microversion: 2.1 time: 0.170872 May 16 15:15:25.776127 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:25 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:25.900994 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c6aa17f8-28ee-4909-8b4b-683eef7f773f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:25.901868 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c6aa17f8-28ee-4909-8b4b-683eef7f773f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:25.921461 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6aa17f8-28ee-4909-8b4b-683eef7f773f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:25.924597 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6aa17f8-28ee-4909-8b4b-683eef7f773f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:25.926644 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6aa17f8-28ee-4909-8b4b-683eef7f773f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:25.927100 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6aa17f8-28ee-4909-8b4b-683eef7f773f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:25.981783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-715f8077-d6d6-4122-a139-0c7253137570 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Action: 'create', calling method: .version_select at 0x7fc9ac9df790>, body: {"keypair": {"name": "tempest-keypair-598819362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtNXvOnZzX4sg1kdpJ/emmlM7N8SGMSU6bw9YIwzvGX0M4/6UavPL2c3om8/j0RBDGFFENaW5tTrWpKDq3xiMaD72npVFe5yIH6ZkGP4qX6GfJbaYaCVQKAGh7SFZllJg=="}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:26.013662 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-715f8077-d6d6-4122-a139-0c7253137570 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Getting quotas for project 9703f082240542aa979c6b53052d77b9. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:26.019265 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-715f8077-d6d6-4122-a139-0c7253137570 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Getting quotas for user 911ef817a1ee4790ad97e857a299fb01 and project 9703f082240542aa979c6b53052d77b9. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:26.118207 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-715f8077-d6d6-4122-a139-0c7253137570 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.809653 May 16 15:15:26.127633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 5/9] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 16 15:15:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:26.290033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c6aa17f8-28ee-4909-8b4b-683eef7f773f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:26.312554 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c6aa17f8-28ee-4909-8b4b-683eef7f773f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1273 microversion: 2.1 time: 0.407425 May 16 15:15:26.318880 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 5/10] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:25 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1273 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:26.624011 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1186733890", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:26.833848 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] validate_networks() for [('8561ad64-1b6b-4f33-82d1-a2d7e72d5b01', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:15:27.330782 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-54a7c695-5ab0-40c8-85e8-3523ba1ec26f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:27.331967 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-54a7c695-5ab0-40c8-85e8-3523ba1ec26f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:27.351382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54a7c695-5ab0-40c8-85e8-3523ba1ec26f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:27.353444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54a7c695-5ab0-40c8-85e8-3523ba1ec26f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:27.354460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54a7c695-5ab0-40c8-85e8-3523ba1ec26f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:27.361669 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54a7c695-5ab0-40c8-85e8-3523ba1ec26f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:27.664289 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-54a7c695-5ab0-40c8-85e8-3523ba1ec26f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:27.672071 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-54a7c695-5ab0-40c8-85e8-3523ba1ec26f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1273 microversion: 2.1 time: 0.345287 May 16 15:15:27.686196 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 6/11] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:27 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1273 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:28.702921 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b16220b9-8bb0-42f6-be6f-a7e0d97d9cfe tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:28.704262 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b16220b9-8bb0-42f6-be6f-a7e0d97d9cfe tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:28.718826 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b16220b9-8bb0-42f6-be6f-a7e0d97d9cfe tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:28.720497 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b16220b9-8bb0-42f6-be6f-a7e0d97d9cfe tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:28.724483 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b16220b9-8bb0-42f6-be6f-a7e0d97d9cfe tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:28.725173 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b16220b9-8bb0-42f6-be6f-a7e0d97d9cfe tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:29.162233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b16220b9-8bb0-42f6-be6f-a7e0d97d9cfe tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:29.173930 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b16220b9-8bb0-42f6-be6f-a7e0d97d9cfe tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.474758 May 16 15:15:29.176903 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 7/12] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:28 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:30.196088 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2d45fb8e-653e-4a7f-8263-edcca6a434be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:30.196088 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2d45fb8e-653e-4a7f-8263-edcca6a434be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:30.227385 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d45fb8e-653e-4a7f-8263-edcca6a434be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:30.230716 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d45fb8e-653e-4a7f-8263-edcca6a434be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:30.230716 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d45fb8e-653e-4a7f-8263-edcca6a434be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:30.245407 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d45fb8e-653e-4a7f-8263-edcca6a434be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:30.918397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2d45fb8e-653e-4a7f-8263-edcca6a434be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:30.942760 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2d45fb8e-653e-4a7f-8263-edcca6a434be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.753344 May 16 15:15:30.944532 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 8/13] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:30 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:31.961796 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3dd43d00-88a5-4cb9-aa0d-277bc1535601 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:31.962404 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3dd43d00-88a5-4cb9-aa0d-277bc1535601 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:31.979046 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3dd43d00-88a5-4cb9-aa0d-277bc1535601 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:31.983739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3dd43d00-88a5-4cb9-aa0d-277bc1535601 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:31.991594 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3dd43d00-88a5-4cb9-aa0d-277bc1535601 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:31.991594 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3dd43d00-88a5-4cb9-aa0d-277bc1535601 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:32.364274 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3dd43d00-88a5-4cb9-aa0d-277bc1535601 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:32.376813 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3dd43d00-88a5-4cb9-aa0d-277bc1535601 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.418357 May 16 15:15:32.377081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 9/14] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:31 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:32.396890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-743604154", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "982c6e92-7848-46dd-811d-5ec569a6da67"}], "security_groups": [{"name": "tempest-securitygroup--149471611"}], "key_name": "tempest-keypair-993705601", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:32.597207 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] validate_networks() for [('982c6e92-7848-46dd-811d-5ec569a6da67', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:15:32.833865 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:15:32.834379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:15:32.834570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:15:32.834973 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:15:32.835390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:15:32.866383 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:32.867895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:32.867895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:32.868091 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:32.962809 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Getting quotas for project 316917d7a31645bfaac651f81154c18f. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:32.977938 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Getting quotas for user a14795cb97ac44b2a7fc1e2f79b12253 and project 316917d7a31645bfaac651f81154c18f. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:33.020063 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:15:33.022977 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:15:33.377002 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5f58e2c6-80db-4172-b87b-f01fd0ec150e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.757922 May 16 15:15:33.382425 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 6/15] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:15:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 6764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:15:33.396048 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a4153103-c75e-41f6-920d-6d06d07db2eb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:33.426311 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a4153103-c75e-41f6-920d-6d06d07db2eb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:33.591536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:15:33.592613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:15:33.593413 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:15:33.594026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:15:33.595181 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:15:33.616393 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:33.616846 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:33.617685 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:33.618214 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:33.653282 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for project d143bc5a616249a7beefc7b27962026b. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:33.660574 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for user 44ffd5660baa40a7a3d6918cb5d31e56 and project d143bc5a616249a7beefc7b27962026b. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:33.677260 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:15:33.680286 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:15:33.868174 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4817abd2-214b-4136-9dbf-0091c4432e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.490254 May 16 15:15:33.876942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 10/16] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:15:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:15:33.889730 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e8d0d535-eef7-4836-b6cb-f5afee9b1493 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:33.892922 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e8d0d535-eef7-4836-b6cb-f5afee9b1493 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:33.915972 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8d0d535-eef7-4836-b6cb-f5afee9b1493 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:33.916520 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8d0d535-eef7-4836-b6cb-f5afee9b1493 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:33.917666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8d0d535-eef7-4836-b6cb-f5afee9b1493 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:33.923168 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8d0d535-eef7-4836-b6cb-f5afee9b1493 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:34.065311 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a4153103-c75e-41f6-920d-6d06d07db2eb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:34.077502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a4153103-c75e-41f6-920d-6d06d07db2eb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1222 microversion: 2.1 time: 0.688038 May 16 15:15:34.081997 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 7/17] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:33 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1222 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:34.105879 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8d1cb473-1bb8-4214-bb7a-37057021151f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:34.105879 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8d1cb473-1bb8-4214-bb7a-37057021151f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:34.329367 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8d1cb473-1bb8-4214-bb7a-37057021151f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:34.345338 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8d1cb473-1bb8-4214-bb7a-37057021151f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1240 microversion: 2.1 time: 0.261918 May 16 15:15:34.351846 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 8/18] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:34 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1240 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:34.437009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e8d0d535-eef7-4836-b6cb-f5afee9b1493 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:34.463404 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e8d0d535-eef7-4836-b6cb-f5afee9b1493 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.572203 May 16 15:15:34.464855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 11/19] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:33 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:35.047784 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-c007523c-ce0e-4778-98ee-f2fd160cd283 req-506df3c1-557e-4367-991b-46fc9eb13c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb4f893-00bf-47fe-8ca4-74f9cfadd2b7", "tag": "c4da502e-bee2-43da-bb06-65e396454359"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:35.069174 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-c007523c-ce0e-4778-98ee-f2fd160cd283 req-506df3c1-557e-4367-991b-46fc9eb13c83 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:35.069815 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-c007523c-ce0e-4778-98ee-f2fd160cd283 req-506df3c1-557e-4367-991b-46fc9eb13c83 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:35.092036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-c007523c-ce0e-4778-98ee-f2fd160cd283 req-506df3c1-557e-4367-991b-46fc9eb13c83 service nova] Creating event network-changed:c4da502e-bee2-43da-bb06-65e396454359 for instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 on hv-cinder-79578 May 16 15:15:35.092577 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-c007523c-ce0e-4778-98ee-f2fd160cd283 req-506df3c1-557e-4367-991b-46fc9eb13c83 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 15:15:35.095443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-25c7780f-81c0-4cd7-93cd-d061ee4c93e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:35.096310 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-25c7780f-81c0-4cd7-93cd-d061ee4c93e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:35.097112 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-25c7780f-81c0-4cd7-93cd-d061ee4c93e6 None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:35.097603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-25c7780f-81c0-4cd7-93cd-d061ee4c93e6 None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:35.099405 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8ea70c60-4bcc-463e-a46d-4420136aeb52 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:35.100230 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8ea70c60-4bcc-463e-a46d-4420136aeb52 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:35.106978 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.compute.rpcapi [None req-25c7780f-81c0-4cd7-93cd-d061ee4c93e6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 15:15:35.108082 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-25c7780f-81c0-4cd7-93cd-d061ee4c93e6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 15:15:35.109959 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ea70c60-4bcc-463e-a46d-4420136aeb52 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:35.114678 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ea70c60-4bcc-463e-a46d-4420136aeb52 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:35.118205 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ea70c60-4bcc-463e-a46d-4420136aeb52 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:35.119079 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ea70c60-4bcc-463e-a46d-4420136aeb52 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:35.158988 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-25c7780f-81c0-4cd7-93cd-d061ee4c93e6 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227734 May 16 15:15:35.159902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 9/20] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:35.229513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8ea70c60-4bcc-463e-a46d-4420136aeb52 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:35.238521 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8ea70c60-4bcc-463e-a46d-4420136aeb52 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1226 microversion: 2.1 time: 0.143266 May 16 15:15:35.242087 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 12/21] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:35 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1226 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:35.367547 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f2faea18-1a62-4daa-a3f7-70d3f6345f92 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:35.368282 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f2faea18-1a62-4daa-a3f7-70d3f6345f92 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:35.481448 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5426e2f0-9473-42ba-8255-e62c5224eb60 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:35.481985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5426e2f0-9473-42ba-8255-e62c5224eb60 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:35.490925 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5426e2f0-9473-42ba-8255-e62c5224eb60 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:35.491957 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5426e2f0-9473-42ba-8255-e62c5224eb60 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:35.494238 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5426e2f0-9473-42ba-8255-e62c5224eb60 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:35.495545 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5426e2f0-9473-42ba-8255-e62c5224eb60 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:35.527176 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f2faea18-1a62-4daa-a3f7-70d3f6345f92 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:35.532773 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f2faea18-1a62-4daa-a3f7-70d3f6345f92 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1240 microversion: 2.1 time: 0.173184 May 16 15:15:35.537129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 10/22] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:35 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1240 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:35.833527 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5426e2f0-9473-42ba-8255-e62c5224eb60 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:35.848781 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5426e2f0-9473-42ba-8255-e62c5224eb60 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.369987 May 16 15:15:35.851435 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 13/23] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:35 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:36.256049 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f759eb31-29b8-472c-9012-67f696459de8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:36.256840 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f759eb31-29b8-472c-9012-67f696459de8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:36.270292 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f759eb31-29b8-472c-9012-67f696459de8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:36.270292 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f759eb31-29b8-472c-9012-67f696459de8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:36.270292 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f759eb31-29b8-472c-9012-67f696459de8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:36.270292 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f759eb31-29b8-472c-9012-67f696459de8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:36.348574 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f759eb31-29b8-472c-9012-67f696459de8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:36.357141 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f759eb31-29b8-472c-9012-67f696459de8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1226 microversion: 2.1 time: 0.105002 May 16 15:15:36.357716 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 11/24] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:36 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:36.382789 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1712878147", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20dfff89-2b4c-4d06-bcfc-8ec2e202af64"}], "security_groups": [{"name": "tempest-securitygroup--20296038"}], "key_name": "tempest-keypair-598819362", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:36.501343 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] validate_networks() for [('20dfff89-2b4c-4d06-bcfc-8ec2e202af64', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:15:36.553153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-49fe6aad-02e7-4913-9963-d7290aa922db tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:36.554025 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-49fe6aad-02e7-4913-9963-d7290aa922db tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:36.561361 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-49fe6aad-02e7-4913-9963-d7290aa922db tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:36.563768 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-49fe6aad-02e7-4913-9963-d7290aa922db tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:36.564643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-49fe6aad-02e7-4913-9963-d7290aa922db tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:36.565287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-49fe6aad-02e7-4913-9963-d7290aa922db tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:36.656584 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-49fe6aad-02e7-4913-9963-d7290aa922db tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:36.664206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-49fe6aad-02e7-4913-9963-d7290aa922db tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1244 microversion: 2.1 time: 0.114749 May 16 15:15:36.665292 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 12/25] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:36 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1244 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:36.867034 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-db68a9ff-986c-4300-8213-399c3f0a0eca tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:36.867657 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-db68a9ff-986c-4300-8213-399c3f0a0eca tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:36.879145 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db68a9ff-986c-4300-8213-399c3f0a0eca tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:36.879666 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db68a9ff-986c-4300-8213-399c3f0a0eca tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:36.880498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db68a9ff-986c-4300-8213-399c3f0a0eca tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:36.883981 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db68a9ff-986c-4300-8213-399c3f0a0eca tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:37.004194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:15:37.004904 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:15:37.018532 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:15:37.018532 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:15:37.018532 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:15:37.030198 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:37.030898 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:37.032183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:37.032947 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:37.056110 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Getting quotas for project 9703f082240542aa979c6b53052d77b9. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:15:37.060444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Getting quotas for user 911ef817a1ee4790ad97e857a299fb01 and project 9703f082240542aa979c6b53052d77b9. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:15:37.077406 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:15:37.080378 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:15:37.264574 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-568d4494-d6d0-44fa-bb39-531a3e9667a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.886038 May 16 15:15:37.266343 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 14/26] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:15:36 2022] POST /compute/v2.1/servers => generated 400 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:15:37.287909 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c88d2b71-5a36-4a30-b985-fa1cd977a4ce tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:37.288761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c88d2b71-5a36-4a30-b985-fa1cd977a4ce tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:37.349826 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c88d2b71-5a36-4a30-b985-fa1cd977a4ce tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:37.358082 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c88d2b71-5a36-4a30-b985-fa1cd977a4ce tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1237 microversion: 2.1 time: 0.073926 May 16 15:15:37.370974 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 15/27] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:37 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:37.377312 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5d9b0f87-eb85-4406-9d22-913f1fa3043a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:37.382953 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5d9b0f87-eb85-4406-9d22-913f1fa3043a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:37.390533 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d9b0f87-eb85-4406-9d22-913f1fa3043a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:37.391187 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d9b0f87-eb85-4406-9d22-913f1fa3043a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:37.397720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d9b0f87-eb85-4406-9d22-913f1fa3043a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:37.397720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d9b0f87-eb85-4406-9d22-913f1fa3043a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:37.478324 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5d9b0f87-eb85-4406-9d22-913f1fa3043a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:37.499093 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5d9b0f87-eb85-4406-9d22-913f1fa3043a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1218 microversion: 2.1 time: 0.126612 May 16 15:15:37.503889 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 16/28] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:37 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:37.681237 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ba572ff1-c28b-4ee5-b3d3-19ec32a25506 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:37.682142 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ba572ff1-c28b-4ee5-b3d3-19ec32a25506 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:37.695379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-db68a9ff-986c-4300-8213-399c3f0a0eca tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:37.721180 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba572ff1-c28b-4ee5-b3d3-19ec32a25506 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:37.722504 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-db68a9ff-986c-4300-8213-399c3f0a0eca tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.854405 May 16 15:15:37.723199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba572ff1-c28b-4ee5-b3d3-19ec32a25506 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:37.724019 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba572ff1-c28b-4ee5-b3d3-19ec32a25506 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:37.724350 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 13/29] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:36 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:37.724483 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba572ff1-c28b-4ee5-b3d3-19ec32a25506 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:37.890832 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ba572ff1-c28b-4ee5-b3d3-19ec32a25506 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:37.899928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ba572ff1-c28b-4ee5-b3d3-19ec32a25506 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1244 microversion: 2.1 time: 0.222854 May 16 15:15:37.903610 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 17/30] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:37 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1244 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:38.380617 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8e712b1e-6583-4994-8f00-a04f11ac3039 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:38.381655 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8e712b1e-6583-4994-8f00-a04f11ac3039 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:38.528250 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e4a7aae1-e844-4c7d-b144-c99e243ea3db tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:38.529955 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e4a7aae1-e844-4c7d-b144-c99e243ea3db tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:38.538494 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8e712b1e-6583-4994-8f00-a04f11ac3039 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:38.544735 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4a7aae1-e844-4c7d-b144-c99e243ea3db tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:38.545372 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4a7aae1-e844-4c7d-b144-c99e243ea3db tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:38.548374 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8e712b1e-6583-4994-8f00-a04f11ac3039 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1237 microversion: 2.1 time: 0.173937 May 16 15:15:38.549293 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4a7aae1-e844-4c7d-b144-c99e243ea3db tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:38.550794 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4a7aae1-e844-4c7d-b144-c99e243ea3db tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:38.562962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 14/31] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:38 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1237 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:38.742853 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bb3add33-399a-436a-a804-88d4ecc026b3 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:38.744216 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bb3add33-399a-436a-a804-88d4ecc026b3 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:38.758447 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb3add33-399a-436a-a804-88d4ecc026b3 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:38.759988 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb3add33-399a-436a-a804-88d4ecc026b3 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:38.762706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb3add33-399a-436a-a804-88d4ecc026b3 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:38.764606 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb3add33-399a-436a-a804-88d4ecc026b3 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:38.782245 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e4a7aae1-e844-4c7d-b144-c99e243ea3db tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:38.792616 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e4a7aae1-e844-4c7d-b144-c99e243ea3db tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1282 microversion: 2.1 time: 0.271707 May 16 15:15:38.804350 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 18/32] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:38 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1282 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:38.922573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0ab0d28f-eb72-4a1f-abb1-7252a53b3236 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:38.923525 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0ab0d28f-eb72-4a1f-abb1-7252a53b3236 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:38.931550 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ab0d28f-eb72-4a1f-abb1-7252a53b3236 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:38.932004 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ab0d28f-eb72-4a1f-abb1-7252a53b3236 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:38.932999 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ab0d28f-eb72-4a1f-abb1-7252a53b3236 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:38.933749 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ab0d28f-eb72-4a1f-abb1-7252a53b3236 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:38.965945 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bb3add33-399a-436a-a804-88d4ecc026b3 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:38.980299 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bb3add33-399a-436a-a804-88d4ecc026b3 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.241430 May 16 15:15:38.983443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 15/33] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:38 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:39.042355 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0ab0d28f-eb72-4a1f-abb1-7252a53b3236 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:39.051707 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0ab0d28f-eb72-4a1f-abb1-7252a53b3236 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1292 microversion: 2.1 time: 0.134666 May 16 15:15:39.061704 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 19/34] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:38 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1292 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:39.583025 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ec07d079-f150-412c-aebe-c3919711a7b1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:39.599437 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ec07d079-f150-412c-aebe-c3919711a7b1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:39.599437 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ec07d079-f150-412c-aebe-c3919711a7b1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.599437 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ec07d079-f150-412c-aebe-c3919711a7b1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.599437 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ec07d079-f150-412c-aebe-c3919711a7b1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.599790 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ec07d079-f150-412c-aebe-c3919711a7b1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.818157 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ec07d079-f150-412c-aebe-c3919711a7b1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:39.832552 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8360591e-fff9-46b7-89ed-1f43d9f0f106 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:39.834931 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8360591e-fff9-46b7-89ed-1f43d9f0f106 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:39.851067 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ec07d079-f150-412c-aebe-c3919711a7b1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1241 microversion: 2.1 time: 0.270282 May 16 15:15:39.853347 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8360591e-fff9-46b7-89ed-1f43d9f0f106 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.868363 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 16/35] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:39 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1241 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:39.869495 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8360591e-fff9-46b7-89ed-1f43d9f0f106 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:39.870947 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8360591e-fff9-46b7-89ed-1f43d9f0f106 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:39.871729 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8360591e-fff9-46b7-89ed-1f43d9f0f106 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.003717 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f23062bf-76f2-490a-85a0-28140e4bb2be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:40.037285 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f23062bf-76f2-490a-85a0-28140e4bb2be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:40.037556 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8360591e-fff9-46b7-89ed-1f43d9f0f106 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:40.037556 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8360591e-fff9-46b7-89ed-1f43d9f0f106 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1282 microversion: 2.1 time: 0.225279 May 16 15:15:40.044255 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 20/36] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:39 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:40.046016 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f23062bf-76f2-490a-85a0-28140e4bb2be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.046755 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f23062bf-76f2-490a-85a0-28140e4bb2be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.047554 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f23062bf-76f2-490a-85a0-28140e4bb2be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.047999 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f23062bf-76f2-490a-85a0-28140e4bb2be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.074784 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-909997cf-4b22-4321-97e6-e3d8887e1b16 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:40.075418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-909997cf-4b22-4321-97e6-e3d8887e1b16 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:40.092982 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-909997cf-4b22-4321-97e6-e3d8887e1b16 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.093609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-909997cf-4b22-4321-97e6-e3d8887e1b16 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.095710 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-909997cf-4b22-4321-97e6-e3d8887e1b16 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.096446 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-909997cf-4b22-4321-97e6-e3d8887e1b16 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.185374 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-909997cf-4b22-4321-97e6-e3d8887e1b16 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:40.198596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-909997cf-4b22-4321-97e6-e3d8887e1b16 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1300 microversion: 2.1 time: 0.127751 May 16 15:15:40.199879 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 21/37] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:40 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1300 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:40.361375 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-7e9d4b9a-4273-414b-90fd-ff257023e748 req-46d3bf7e-c7d1-4b67-bd0e-ead617c6a8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cc0b00-99f9-4486-b349-f60a0d2db023", "tag": "d3200ba0-e507-4313-a271-660316264ca6"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:40.394326 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-7e9d4b9a-4273-414b-90fd-ff257023e748 req-46d3bf7e-c7d1-4b67-bd0e-ead617c6a8b2 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.394830 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-7e9d4b9a-4273-414b-90fd-ff257023e748 req-46d3bf7e-c7d1-4b67-bd0e-ead617c6a8b2 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.400872 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f23062bf-76f2-490a-85a0-28140e4bb2be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:40.425250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f23062bf-76f2-490a-85a0-28140e4bb2be tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.427763 May 16 15:15:40.425956 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 17/38] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:39 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:40.439411 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-7e9d4b9a-4273-414b-90fd-ff257023e748 req-46d3bf7e-c7d1-4b67-bd0e-ead617c6a8b2 service nova] Creating event network-changed:d3200ba0-e507-4313-a271-660316264ca6 for instance b8cc0b00-99f9-4486-b349-f60a0d2db023 on hv-cinder-79578 May 16 15:15:40.468304 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-7e9d4b9a-4273-414b-90fd-ff257023e748 req-46d3bf7e-c7d1-4b67-bd0e-ead617c6a8b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117649) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 15:15:40.469565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e6547eef-9185-4d4b-9501-9823c78a1e62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.470010 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e6547eef-9185-4d4b-9501-9823c78a1e62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.478231 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e6547eef-9185-4d4b-9501-9823c78a1e62 None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.478940 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e6547eef-9185-4d4b-9501-9823c78a1e62 None None] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.501981 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.compute.rpcapi [None req-e6547eef-9185-4d4b-9501-9823c78a1e62 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 15:15:40.502897 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e6547eef-9185-4d4b-9501-9823c78a1e62 None None] Releasing lock "compute-rpcapi-router" {{(pid=117649) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 15:15:40.555269 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e6547eef-9185-4d4b-9501-9823c78a1e62 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198040 May 16 15:15:40.556161 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 22/39] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:40.876892 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f208fc2d-a38b-4967-92d3-c0132d0536b2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:40.878262 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f208fc2d-a38b-4967-92d3-c0132d0536b2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:40.886429 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f208fc2d-a38b-4967-92d3-c0132d0536b2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.886893 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f208fc2d-a38b-4967-92d3-c0132d0536b2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:40.887690 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f208fc2d-a38b-4967-92d3-c0132d0536b2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:40.893244 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f208fc2d-a38b-4967-92d3-c0132d0536b2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:41.055091 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-228e5c2c-1385-4a6d-bb25-ba6478796a63 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:41.056063 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-228e5c2c-1385-4a6d-bb25-ba6478796a63 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:41.083005 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-228e5c2c-1385-4a6d-bb25-ba6478796a63 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.083452 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-228e5c2c-1385-4a6d-bb25-ba6478796a63 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:41.092523 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-228e5c2c-1385-4a6d-bb25-ba6478796a63 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.106973 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-228e5c2c-1385-4a6d-bb25-ba6478796a63 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:41.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f208fc2d-a38b-4967-92d3-c0132d0536b2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:41.159634 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f208fc2d-a38b-4967-92d3-c0132d0536b2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1289 microversion: 2.1 time: 0.287209 May 16 15:15:41.161618 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 18/40] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:40 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1289 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:41.224915 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9df0e65e-75e9-48f0-b267-668f67eaaa1c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:41.225568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9df0e65e-75e9-48f0-b267-668f67eaaa1c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:41.232147 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9df0e65e-75e9-48f0-b267-668f67eaaa1c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.232964 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9df0e65e-75e9-48f0-b267-668f67eaaa1c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:41.233982 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9df0e65e-75e9-48f0-b267-668f67eaaa1c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.234626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9df0e65e-75e9-48f0-b267-668f67eaaa1c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:41.307173 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9df0e65e-75e9-48f0-b267-668f67eaaa1c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:41.315055 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9df0e65e-75e9-48f0-b267-668f67eaaa1c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1298 microversion: 2.1 time: 0.095110 May 16 15:15:41.315641 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 19/41] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:41 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:41.402630 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-228e5c2c-1385-4a6d-bb25-ba6478796a63 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:41.412610 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-228e5c2c-1385-4a6d-bb25-ba6478796a63 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1280 microversion: 2.1 time: 0.365232 May 16 15:15:41.414597 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 23/42] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:41 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1280 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:41.444840 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-79ddf0dc-80e9-45df-974d-d0b103e5d328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:41.444840 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-79ddf0dc-80e9-45df-974d-d0b103e5d328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:41.460001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-79ddf0dc-80e9-45df-974d-d0b103e5d328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.460463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-79ddf0dc-80e9-45df-974d-d0b103e5d328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:41.461257 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-79ddf0dc-80e9-45df-974d-d0b103e5d328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:41.461705 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-79ddf0dc-80e9-45df-974d-d0b103e5d328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:42.084569 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-79ddf0dc-80e9-45df-974d-d0b103e5d328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:42.097804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-79ddf0dc-80e9-45df-974d-d0b103e5d328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.658201 May 16 15:15:42.100834 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 20/43] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:41 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:42.179487 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b18e5f01-3079-4be1-b478-9637706ffddd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:42.180952 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b18e5f01-3079-4be1-b478-9637706ffddd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:42.193742 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b18e5f01-3079-4be1-b478-9637706ffddd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:42.194654 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b18e5f01-3079-4be1-b478-9637706ffddd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:42.199897 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b18e5f01-3079-4be1-b478-9637706ffddd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:42.200607 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b18e5f01-3079-4be1-b478-9637706ffddd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:42.332495 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-30acbf06-a047-4a7f-ab4f-8029728e8f1f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:42.333109 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-30acbf06-a047-4a7f-ab4f-8029728e8f1f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:42.352154 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-30acbf06-a047-4a7f-ab4f-8029728e8f1f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:42.353481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-30acbf06-a047-4a7f-ab4f-8029728e8f1f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:42.354770 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-30acbf06-a047-4a7f-ab4f-8029728e8f1f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:42.355470 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-30acbf06-a047-4a7f-ab4f-8029728e8f1f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:42.491473 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b18e5f01-3079-4be1-b478-9637706ffddd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:42.501009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b18e5f01-3079-4be1-b478-9637706ffddd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1307 microversion: 2.1 time: 0.326163 May 16 15:15:42.503509 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 24/44] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:42 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1307 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:42.565748 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dbfcdcab-da38-47d6-8059-fa1f50414cc8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:42.568351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dbfcdcab-da38-47d6-8059-fa1f50414cc8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:42.587107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbfcdcab-da38-47d6-8059-fa1f50414cc8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:42.588965 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbfcdcab-da38-47d6-8059-fa1f50414cc8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:42.594003 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbfcdcab-da38-47d6-8059-fa1f50414cc8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:42.597151 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbfcdcab-da38-47d6-8059-fa1f50414cc8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:42.834021 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-30acbf06-a047-4a7f-ab4f-8029728e8f1f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:42.855415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-30acbf06-a047-4a7f-ab4f-8029728e8f1f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.525194 May 16 15:15:42.865104 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 21/45] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:42 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:43.116446 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-90b515c8-4a17-4bd7-8eb9-3948c7271456 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:43.118371 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-90b515c8-4a17-4bd7-8eb9-3948c7271456 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:43.131144 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90b515c8-4a17-4bd7-8eb9-3948c7271456 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:43.131600 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90b515c8-4a17-4bd7-8eb9-3948c7271456 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:43.132389 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90b515c8-4a17-4bd7-8eb9-3948c7271456 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:43.147690 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90b515c8-4a17-4bd7-8eb9-3948c7271456 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:43.353168 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dbfcdcab-da38-47d6-8059-fa1f50414cc8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:43.361997 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dbfcdcab-da38-47d6-8059-fa1f50414cc8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.855601 May 16 15:15:43.372934 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 25/46] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:42 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:43.527401 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-769ae57e-a2b9-4491-8976-bdb1ea67ab37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:43.528015 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-769ae57e-a2b9-4491-8976-bdb1ea67ab37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:43.534094 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-769ae57e-a2b9-4491-8976-bdb1ea67ab37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:43.534569 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-769ae57e-a2b9-4491-8976-bdb1ea67ab37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:43.535371 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-769ae57e-a2b9-4491-8976-bdb1ea67ab37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:43.535804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-769ae57e-a2b9-4491-8976-bdb1ea67ab37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:43.642697 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-769ae57e-a2b9-4491-8976-bdb1ea67ab37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:43.650774 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-769ae57e-a2b9-4491-8976-bdb1ea67ab37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1295 microversion: 2.1 time: 0.128447 May 16 15:15:43.662047 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 26/47] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:43 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1295 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:43.779796 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-90b515c8-4a17-4bd7-8eb9-3948c7271456 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:43.785511 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-90b515c8-4a17-4bd7-8eb9-3948c7271456 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.673714 May 16 15:15:43.795332 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 22/48] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:43 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:43.872614 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1dc844f2-0ddd-48bf-ba33-b7b169b72441 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:43.873329 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1dc844f2-0ddd-48bf-ba33-b7b169b72441 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:43.897477 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1dc844f2-0ddd-48bf-ba33-b7b169b72441 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:43.900357 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1dc844f2-0ddd-48bf-ba33-b7b169b72441 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:43.902389 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1dc844f2-0ddd-48bf-ba33-b7b169b72441 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:43.907704 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1dc844f2-0ddd-48bf-ba33-b7b169b72441 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.135446 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1dc844f2-0ddd-48bf-ba33-b7b169b72441 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:44.143495 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1dc844f2-0ddd-48bf-ba33-b7b169b72441 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.275294 May 16 15:15:44.144362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 27/49] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:43 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:44.384268 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-32f7be72-93fe-4271-9cc9-e07bc738f606 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:44.385669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-32f7be72-93fe-4271-9cc9-e07bc738f606 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:44.398230 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-32f7be72-93fe-4271-9cc9-e07bc738f606 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.400230 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-32f7be72-93fe-4271-9cc9-e07bc738f606 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.401521 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-32f7be72-93fe-4271-9cc9-e07bc738f606 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.402249 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-32f7be72-93fe-4271-9cc9-e07bc738f606 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.630855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-32f7be72-93fe-4271-9cc9-e07bc738f606 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:44.640230 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-32f7be72-93fe-4271-9cc9-e07bc738f606 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.264067 May 16 15:15:44.643496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 23/50] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:44 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:44.669118 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-09649271-6a26-45a6-9ed3-5c6ff8a9b949 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:44.669739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-09649271-6a26-45a6-9ed3-5c6ff8a9b949 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:44.678697 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09649271-6a26-45a6-9ed3-5c6ff8a9b949 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.679149 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09649271-6a26-45a6-9ed3-5c6ff8a9b949 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.681218 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09649271-6a26-45a6-9ed3-5c6ff8a9b949 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.683351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09649271-6a26-45a6-9ed3-5c6ff8a9b949 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.805133 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b2309f9c-ad26-46d0-b454-66143fcf7da9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:44.807300 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b2309f9c-ad26-46d0-b454-66143fcf7da9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:44.823025 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b2309f9c-ad26-46d0-b454-66143fcf7da9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.825985 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b2309f9c-ad26-46d0-b454-66143fcf7da9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.829352 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b2309f9c-ad26-46d0-b454-66143fcf7da9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:44.830036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b2309f9c-ad26-46d0-b454-66143fcf7da9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:44.981029 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-09649271-6a26-45a6-9ed3-5c6ff8a9b949 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:44.989951 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-09649271-6a26-45a6-9ed3-5c6ff8a9b949 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.324647 May 16 15:15:44.991382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 28/51] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:44 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:45.044391 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b2309f9c-ad26-46d0-b454-66143fcf7da9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:45.064923 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b2309f9c-ad26-46d0-b454-66143fcf7da9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.265569 May 16 15:15:45.093379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 24/52] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:44 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:45.165508 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7346d81d-2024-4a86-be90-7d46531859a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:45.166234 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7346d81d-2024-4a86-be90-7d46531859a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:45.174567 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7346d81d-2024-4a86-be90-7d46531859a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:45.175025 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7346d81d-2024-4a86-be90-7d46531859a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:45.175834 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7346d81d-2024-4a86-be90-7d46531859a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:45.176273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7346d81d-2024-4a86-be90-7d46531859a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:45.368291 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-9f83246a-fbc7-4cf9-961d-fb349d595e1c req-569a71f4-fee7-4898-9fd5-a10fda5a52cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd44422c-b621-4ad8-82ab-e5eeae7b2633", "tag": "a1eae8f4-b207-4d48-bdf5-dfab72b3d846"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:45.383848 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-9f83246a-fbc7-4cf9-961d-fb349d595e1c req-569a71f4-fee7-4898-9fd5-a10fda5a52cb service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:45.384405 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-9f83246a-fbc7-4cf9-961d-fb349d595e1c req-569a71f4-fee7-4898-9fd5-a10fda5a52cb service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:45.402889 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-9f83246a-fbc7-4cf9-961d-fb349d595e1c req-569a71f4-fee7-4898-9fd5-a10fda5a52cb service nova] Creating event network-changed:a1eae8f4-b207-4d48-bdf5-dfab72b3d846 for instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 on hv-cinder-79578 May 16 15:15:45.411733 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-9f83246a-fbc7-4cf9-961d-fb349d595e1c req-569a71f4-fee7-4898-9fd5-a10fda5a52cb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139193 May 16 15:15:45.412542 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 25/53] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:45.547017 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7346d81d-2024-4a86-be90-7d46531859a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:45.554687 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7346d81d-2024-4a86-be90-7d46531859a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.396980 May 16 15:15:45.555274 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 29/54] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:45 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:45.670154 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4aeae318-cef1-4344-9005-d5e27bcbdb6d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:45.671615 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4aeae318-cef1-4344-9005-d5e27bcbdb6d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:45.695004 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4aeae318-cef1-4344-9005-d5e27bcbdb6d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:45.699444 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4aeae318-cef1-4344-9005-d5e27bcbdb6d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:45.708594 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4aeae318-cef1-4344-9005-d5e27bcbdb6d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:45.709698 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4aeae318-cef1-4344-9005-d5e27bcbdb6d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:46.011848 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ee1358aa-9c7d-4315-81b0-42b353b1f611 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:46.012646 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ee1358aa-9c7d-4315-81b0-42b353b1f611 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:46.023812 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee1358aa-9c7d-4315-81b0-42b353b1f611 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:46.025147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee1358aa-9c7d-4315-81b0-42b353b1f611 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:46.027443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee1358aa-9c7d-4315-81b0-42b353b1f611 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:46.030124 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee1358aa-9c7d-4315-81b0-42b353b1f611 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:46.166962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4aeae318-cef1-4344-9005-d5e27bcbdb6d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:46.176666 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4aeae318-cef1-4344-9005-d5e27bcbdb6d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.521283 May 16 15:15:46.199926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 26/55] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:45 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:46.209873 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-487adc9a-5846-4bd9-9557-841409deb19e tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:46.210820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-487adc9a-5846-4bd9-9557-841409deb19e tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:46.220161 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-487adc9a-5846-4bd9-9557-841409deb19e tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:46.220630 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-487adc9a-5846-4bd9-9557-841409deb19e tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:46.221994 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-487adc9a-5846-4bd9-9557-841409deb19e tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:46.222667 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-487adc9a-5846-4bd9-9557-841409deb19e tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:46.418132 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-487adc9a-5846-4bd9-9557-841409deb19e tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:46.423853 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-487adc9a-5846-4bd9-9557-841409deb19e tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.219835 May 16 15:15:46.425125 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 27/56] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:46 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:46.462461 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee1358aa-9c7d-4315-81b0-42b353b1f611 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:46.471920 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ee1358aa-9c7d-4315-81b0-42b353b1f611 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.467437 May 16 15:15:46.472742 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 30/57] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:46 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:46.575935 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5405ae8d-10a6-470d-a6e8-e9495afc02d7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:46.576836 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5405ae8d-10a6-470d-a6e8-e9495afc02d7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:46.585633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5405ae8d-10a6-470d-a6e8-e9495afc02d7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:46.594443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5405ae8d-10a6-470d-a6e8-e9495afc02d7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:46.595293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5405ae8d-10a6-470d-a6e8-e9495afc02d7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:46.595729 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5405ae8d-10a6-470d-a6e8-e9495afc02d7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.017324 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5405ae8d-10a6-470d-a6e8-e9495afc02d7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:47.031706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5405ae8d-10a6-470d-a6e8-e9495afc02d7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.458563 May 16 15:15:47.040705 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 28/58] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:46 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:47.200720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e1ec9a26-8d19-4bbf-8680-dc807682667f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:47.201826 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e1ec9a26-8d19-4bbf-8680-dc807682667f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:47.213798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1ec9a26-8d19-4bbf-8680-dc807682667f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.214544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1ec9a26-8d19-4bbf-8680-dc807682667f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.221717 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1ec9a26-8d19-4bbf-8680-dc807682667f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.221717 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1ec9a26-8d19-4bbf-8680-dc807682667f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.277186 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-67eaae7f-6d9f-4cbe-8e7c-925a5daef8bb req-5cacb214-06ef-4565-ac0f-59831f4432c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e68f7e-80df-470a-869e-8c625ab4709c", "tag": "c2d12348-be99-4d8a-833b-0746887f6b11"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:47.290580 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-67eaae7f-6d9f-4cbe-8e7c-925a5daef8bb req-5cacb214-06ef-4565-ac0f-59831f4432c2 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.291047 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-67eaae7f-6d9f-4cbe-8e7c-925a5daef8bb req-5cacb214-06ef-4565-ac0f-59831f4432c2 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.317782 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-67eaae7f-6d9f-4cbe-8e7c-925a5daef8bb req-5cacb214-06ef-4565-ac0f-59831f4432c2 service nova] Creating event network-changed:c2d12348-be99-4d8a-833b-0746887f6b11 for instance f3e68f7e-80df-470a-869e-8c625ab4709c on hv-cinder-79578 May 16 15:15:47.326735 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-67eaae7f-6d9f-4cbe-8e7c-925a5daef8bb req-5cacb214-06ef-4565-ac0f-59831f4432c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053648 May 16 15:15:47.328044 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 29/59] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:47.442199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5c04b1c4-48d6-40dd-8ab5-c6df7dea7e9b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:47.446267 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5c04b1c4-48d6-40dd-8ab5-c6df7dea7e9b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:47.456538 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c04b1c4-48d6-40dd-8ab5-c6df7dea7e9b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.463066 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c04b1c4-48d6-40dd-8ab5-c6df7dea7e9b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.464339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c04b1c4-48d6-40dd-8ab5-c6df7dea7e9b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.466342 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c04b1c4-48d6-40dd-8ab5-c6df7dea7e9b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.510961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e1ec9a26-8d19-4bbf-8680-dc807682667f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:47.518942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e1ec9a26-8d19-4bbf-8680-dc807682667f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.322105 May 16 15:15:47.525568 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 31/60] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:47 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:47.527480 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-5ddc0798-220c-4469-b3b9-e856f5d5b3a8 req-785e291d-f42a-4b3c-a487-b0a582986f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766a2d7d-3279-4c55-9dfb-29746e7fd0f0", "tag": "478148b0-c270-4a3b-8603-9ce967e01679"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:47.542821 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-5ddc0798-220c-4469-b3b9-e856f5d5b3a8 req-785e291d-f42a-4b3c-a487-b0a582986f70 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.543512 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-5ddc0798-220c-4469-b3b9-e856f5d5b3a8 req-785e291d-f42a-4b3c-a487-b0a582986f70 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.577462 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-5ddc0798-220c-4469-b3b9-e856f5d5b3a8 req-785e291d-f42a-4b3c-a487-b0a582986f70 service nova] Creating event network-changed:478148b0-c270-4a3b-8603-9ce967e01679 for instance 766a2d7d-3279-4c55-9dfb-29746e7fd0f0 on hv-cinder-79578 May 16 15:15:47.587891 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-5ddc0798-220c-4469-b3b9-e856f5d5b3a8 req-785e291d-f42a-4b3c-a487-b0a582986f70 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064332 May 16 15:15:47.588939 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 32/61] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:47.594850 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-965950ab-d9b4-43df-a9bd-f2933870dae5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:47.595538 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-965950ab-d9b4-43df-a9bd-f2933870dae5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:47.602196 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-965950ab-d9b4-43df-a9bd-f2933870dae5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.602831 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-965950ab-d9b4-43df-a9bd-f2933870dae5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.603781 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-965950ab-d9b4-43df-a9bd-f2933870dae5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:47.604385 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-965950ab-d9b4-43df-a9bd-f2933870dae5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:47.720013 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5c04b1c4-48d6-40dd-8ab5-c6df7dea7e9b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:47.732443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5c04b1c4-48d6-40dd-8ab5-c6df7dea7e9b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.294695 May 16 15:15:47.733404 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 30/62] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:47 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:47.833662 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-965950ab-d9b4-43df-a9bd-f2933870dae5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:47.845765 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-965950ab-d9b4-43df-a9bd-f2933870dae5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.255503 May 16 15:15:47.847564 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 33/63] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:47 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:48.048254 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-74e3310b-a790-4cac-9a7a-5f0201639999 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:48.048858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-74e3310b-a790-4cac-9a7a-5f0201639999 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:48.057037 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-74e3310b-a790-4cac-9a7a-5f0201639999 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.058858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-74e3310b-a790-4cac-9a7a-5f0201639999 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.060145 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-74e3310b-a790-4cac-9a7a-5f0201639999 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.061785 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-74e3310b-a790-4cac-9a7a-5f0201639999 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.323876 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-74e3310b-a790-4cac-9a7a-5f0201639999 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:48.332397 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-74e3310b-a790-4cac-9a7a-5f0201639999 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.287704 May 16 15:15:48.332981 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 31/64] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:48 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:48.538380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-819dbe1f-dbdb-4e01-8736-4502d4d0991b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:48.538995 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-819dbe1f-dbdb-4e01-8736-4502d4d0991b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:48.546652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-819dbe1f-dbdb-4e01-8736-4502d4d0991b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.553872 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-819dbe1f-dbdb-4e01-8736-4502d4d0991b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.554672 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-819dbe1f-dbdb-4e01-8736-4502d4d0991b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.555117 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-819dbe1f-dbdb-4e01-8736-4502d4d0991b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.737626 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-819dbe1f-dbdb-4e01-8736-4502d4d0991b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:48.746943 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-819dbe1f-dbdb-4e01-8736-4502d4d0991b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.212436 May 16 15:15:48.757276 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 34/65] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:48 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:48.757375 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6adede50-f7b3-48cf-bca6-981bf21214d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:48.757375 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6adede50-f7b3-48cf-bca6-981bf21214d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:48.763357 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6adede50-f7b3-48cf-bca6-981bf21214d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.763894 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6adede50-f7b3-48cf-bca6-981bf21214d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.765751 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6adede50-f7b3-48cf-bca6-981bf21214d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.766305 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6adede50-f7b3-48cf-bca6-981bf21214d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.868544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cdfddb1f-3202-4b67-aa5c-39fc3efaae27 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:48.875595 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cdfddb1f-3202-4b67-aa5c-39fc3efaae27 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:48.884459 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdfddb1f-3202-4b67-aa5c-39fc3efaae27 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.885402 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdfddb1f-3202-4b67-aa5c-39fc3efaae27 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.887940 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdfddb1f-3202-4b67-aa5c-39fc3efaae27 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:48.887940 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdfddb1f-3202-4b67-aa5c-39fc3efaae27 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:48.962701 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6adede50-f7b3-48cf-bca6-981bf21214d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:48.980120 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6adede50-f7b3-48cf-bca6-981bf21214d9 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.233902 May 16 15:15:48.987847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 32/66] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:48 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:49.073627 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cdfddb1f-3202-4b67-aa5c-39fc3efaae27 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:49.085722 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cdfddb1f-3202-4b67-aa5c-39fc3efaae27 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.221466 May 16 15:15:49.085722 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 35/67] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:48 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:49.354121 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1c1c1317-60b9-4acc-8adf-4ee6c7c625e9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:49.354747 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1c1c1317-60b9-4acc-8adf-4ee6c7c625e9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:49.366145 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c1c1317-60b9-4acc-8adf-4ee6c7c625e9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.366899 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c1c1317-60b9-4acc-8adf-4ee6c7c625e9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.368068 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c1c1317-60b9-4acc-8adf-4ee6c7c625e9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.371246 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c1c1317-60b9-4acc-8adf-4ee6c7c625e9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.620765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1c1c1317-60b9-4acc-8adf-4ee6c7c625e9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:49.634503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1c1c1317-60b9-4acc-8adf-4ee6c7c625e9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.283520 May 16 15:15:49.636429 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 33/68] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:49 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:49.765014 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ed02b61a-0616-4536-8e82-1fa7caaed830 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:49.765618 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ed02b61a-0616-4536-8e82-1fa7caaed830 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:49.772433 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed02b61a-0616-4536-8e82-1fa7caaed830 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.772996 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed02b61a-0616-4536-8e82-1fa7caaed830 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.773768 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed02b61a-0616-4536-8e82-1fa7caaed830 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.776415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed02b61a-0616-4536-8e82-1fa7caaed830 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.860844 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-e1e2686e-5723-45a3-9cc9-5b10f05f1cd2 req-a1a40132-f61a-48a2-940a-44126e9843df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb4f893-00bf-47fe-8ca4-74f9cfadd2b7", "name": "network-vif-plugged", "status": "completed", "tag": "c4da502e-bee2-43da-bb06-65e396454359"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:49.869607 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e1e2686e-5723-45a3-9cc9-5b10f05f1cd2 req-a1a40132-f61a-48a2-940a-44126e9843df service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:49.870448 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e1e2686e-5723-45a3-9cc9-5b10f05f1cd2 req-a1a40132-f61a-48a2-940a-44126e9843df service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:49.888744 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-e1e2686e-5723-45a3-9cc9-5b10f05f1cd2 req-a1a40132-f61a-48a2-940a-44126e9843df service nova] Creating event network-vif-plugged:c4da502e-bee2-43da-bb06-65e396454359 for instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 on hv-cinder-79578 May 16 15:15:49.902837 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-e1e2686e-5723-45a3-9cc9-5b10f05f1cd2 req-a1a40132-f61a-48a2-940a-44126e9843df service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141862 May 16 15:15:49.903844 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 36/69] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:49.940424 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ed02b61a-0616-4536-8e82-1fa7caaed830 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:49.948082 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ed02b61a-0616-4536-8e82-1fa7caaed830 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.187265 May 16 15:15:49.957513 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 34/70] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:49 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:49.997171 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0bb4a2ba-e464-438a-990a-fe9ebc2655b2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:49.997865 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0bb4a2ba-e464-438a-990a-fe9ebc2655b2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:50.014983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bb4a2ba-e464-438a-990a-fe9ebc2655b2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.015447 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bb4a2ba-e464-438a-990a-fe9ebc2655b2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.016249 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bb4a2ba-e464-438a-990a-fe9ebc2655b2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.016689 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bb4a2ba-e464-438a-990a-fe9ebc2655b2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.100566 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a04cc587-8b92-4398-bcb2-84caea797ab2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:50.101201 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a04cc587-8b92-4398-bcb2-84caea797ab2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:50.109334 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a04cc587-8b92-4398-bcb2-84caea797ab2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.109783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a04cc587-8b92-4398-bcb2-84caea797ab2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.110670 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a04cc587-8b92-4398-bcb2-84caea797ab2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.111252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a04cc587-8b92-4398-bcb2-84caea797ab2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.156107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0bb4a2ba-e464-438a-990a-fe9ebc2655b2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:50.163944 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0bb4a2ba-e464-438a-990a-fe9ebc2655b2 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.170985 May 16 15:15:50.164511 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 37/71] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:49 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:50.273470 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a04cc587-8b92-4398-bcb2-84caea797ab2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:50.281983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a04cc587-8b92-4398-bcb2-84caea797ab2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.185890 May 16 15:15:50.282715 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 35/72] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:50 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:50.652759 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-845ae7a7-52a6-41ad-a3a1-fa4ea4fb5b11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:50.656291 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-845ae7a7-52a6-41ad-a3a1-fa4ea4fb5b11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:50.663158 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-845ae7a7-52a6-41ad-a3a1-fa4ea4fb5b11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.663634 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-845ae7a7-52a6-41ad-a3a1-fa4ea4fb5b11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.664420 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-845ae7a7-52a6-41ad-a3a1-fa4ea4fb5b11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.665024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-845ae7a7-52a6-41ad-a3a1-fa4ea4fb5b11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.804245 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-845ae7a7-52a6-41ad-a3a1-fa4ea4fb5b11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:50.811553 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-845ae7a7-52a6-41ad-a3a1-fa4ea4fb5b11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.162549 May 16 15:15:50.812110 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 38/73] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:50 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:50.974103 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-94776ed7-3ec7-4dd6-b6bb-621672c18695 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:50.974794 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-94776ed7-3ec7-4dd6-b6bb-621672c18695 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:50.980954 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-94776ed7-3ec7-4dd6-b6bb-621672c18695 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.981402 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-94776ed7-3ec7-4dd6-b6bb-621672c18695 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:50.982197 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-94776ed7-3ec7-4dd6-b6bb-621672c18695 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:50.982632 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-94776ed7-3ec7-4dd6-b6bb-621672c18695 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.147050 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-94776ed7-3ec7-4dd6-b6bb-621672c18695 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:51.154394 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-94776ed7-3ec7-4dd6-b6bb-621672c18695 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.184216 May 16 15:15:51.154991 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 36/74] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:50 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:51.181137 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-14eadb09-0c6a-4047-8beb-78882e72aca6 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:51.181929 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-14eadb09-0c6a-4047-8beb-78882e72aca6 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:51.188332 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14eadb09-0c6a-4047-8beb-78882e72aca6 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.188847 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14eadb09-0c6a-4047-8beb-78882e72aca6 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.189696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14eadb09-0c6a-4047-8beb-78882e72aca6 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.190231 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14eadb09-0c6a-4047-8beb-78882e72aca6 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.299447 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-eadff315-7feb-4ece-b504-e47c5ff25b0a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:51.300046 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-eadff315-7feb-4ece-b504-e47c5ff25b0a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:51.306173 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eadff315-7feb-4ece-b504-e47c5ff25b0a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.306830 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eadff315-7feb-4ece-b504-e47c5ff25b0a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.307598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eadff315-7feb-4ece-b504-e47c5ff25b0a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.308029 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eadff315-7feb-4ece-b504-e47c5ff25b0a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.372202 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-14eadb09-0c6a-4047-8beb-78882e72aca6 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:51.382370 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-14eadb09-0c6a-4047-8beb-78882e72aca6 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.204953 May 16 15:15:51.393227 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 39/75] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:51 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:51.506545 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-eadff315-7feb-4ece-b504-e47c5ff25b0a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:51.514175 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-eadff315-7feb-4ece-b504-e47c5ff25b0a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.218637 May 16 15:15:51.515589 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 37/76] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:51 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:51.828283 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-07e40bce-eac4-47d4-8953-86b3ca653d15 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:51.829040 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-07e40bce-eac4-47d4-8953-86b3ca653d15 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:51.834957 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07e40bce-eac4-47d4-8953-86b3ca653d15 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.835592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07e40bce-eac4-47d4-8953-86b3ca653d15 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.836257 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07e40bce-eac4-47d4-8953-86b3ca653d15 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:51.836683 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07e40bce-eac4-47d4-8953-86b3ca653d15 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:51.978488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-07e40bce-eac4-47d4-8953-86b3ca653d15 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:51.986673 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-07e40bce-eac4-47d4-8953-86b3ca653d15 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.162206 May 16 15:15:51.987187 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 40/77] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:51 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:52.173506 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c422ee44-1529-4ce8-a39c-ed48dee890cb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:52.174116 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c422ee44-1529-4ce8-a39c-ed48dee890cb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:52.180311 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c422ee44-1529-4ce8-a39c-ed48dee890cb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.180727 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c422ee44-1529-4ce8-a39c-ed48dee890cb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:52.181495 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c422ee44-1529-4ce8-a39c-ed48dee890cb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.181923 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c422ee44-1529-4ce8-a39c-ed48dee890cb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:52.335400 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c422ee44-1529-4ce8-a39c-ed48dee890cb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:52.344000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c422ee44-1529-4ce8-a39c-ed48dee890cb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.176718 May 16 15:15:52.344576 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 38/78] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:52 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:52.400693 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4fffc7b7-9dd6-404e-867a-be7b7c86b807 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:52.406330 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4fffc7b7-9dd6-404e-867a-be7b7c86b807 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:52.413308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fffc7b7-9dd6-404e-867a-be7b7c86b807 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.413751 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fffc7b7-9dd6-404e-867a-be7b7c86b807 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:52.415056 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fffc7b7-9dd6-404e-867a-be7b7c86b807 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.415696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fffc7b7-9dd6-404e-867a-be7b7c86b807 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:52.543140 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bf0a5085-ebf6-4669-b692-5740439180c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:52.543140 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bf0a5085-ebf6-4669-b692-5740439180c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:52.545676 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bf0a5085-ebf6-4669-b692-5740439180c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.546194 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bf0a5085-ebf6-4669-b692-5740439180c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:52.547239 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bf0a5085-ebf6-4669-b692-5740439180c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:52.547670 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bf0a5085-ebf6-4669-b692-5740439180c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:52.580019 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4fffc7b7-9dd6-404e-867a-be7b7c86b807 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:52.587524 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4fffc7b7-9dd6-404e-867a-be7b7c86b807 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.190594 May 16 15:15:52.588121 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 41/79] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:52 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:52.734309 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bf0a5085-ebf6-4669-b692-5740439180c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:52.741033 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bf0a5085-ebf6-4669-b692-5740439180c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.212661 May 16 15:15:52.741848 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 39/80] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:52 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:53.010411 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-97c760ae-b9a2-4ecd-b6b8-5ec0385f7841 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:53.011104 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-97c760ae-b9a2-4ecd-b6b8-5ec0385f7841 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:53.019297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97c760ae-b9a2-4ecd-b6b8-5ec0385f7841 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.019846 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97c760ae-b9a2-4ecd-b6b8-5ec0385f7841 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.020693 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97c760ae-b9a2-4ecd-b6b8-5ec0385f7841 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.021201 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97c760ae-b9a2-4ecd-b6b8-5ec0385f7841 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.147140 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-97c760ae-b9a2-4ecd-b6b8-5ec0385f7841 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:53.154693 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-97c760ae-b9a2-4ecd-b6b8-5ec0385f7841 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.154973 May 16 15:15:53.155255 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 42/81] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:52 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:53.361561 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3502ef0c-ac78-40ad-af7c-9791f8fe82cf tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:53.362323 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3502ef0c-ac78-40ad-af7c-9791f8fe82cf tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:53.372435 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3502ef0c-ac78-40ad-af7c-9791f8fe82cf tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.372900 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3502ef0c-ac78-40ad-af7c-9791f8fe82cf tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.377048 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3502ef0c-ac78-40ad-af7c-9791f8fe82cf tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.377517 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3502ef0c-ac78-40ad-af7c-9791f8fe82cf tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.591262 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-00f55057-be28-4448-a57a-49127f28b826 req-85efae6c-794f-4c9c-afaa-65e1870c11b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cc0b00-99f9-4486-b349-f60a0d2db023", "name": "network-vif-plugged", "status": "completed", "tag": "d3200ba0-e507-4313-a271-660316264ca6"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:53.612898 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3502ef0c-ac78-40ad-af7c-9791f8fe82cf tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:53.616800 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-00f55057-be28-4448-a57a-49127f28b826 req-85efae6c-794f-4c9c-afaa-65e1870c11b8 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.617525 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-00f55057-be28-4448-a57a-49127f28b826 req-85efae6c-794f-4c9c-afaa-65e1870c11b8 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.622139 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3502ef0c-ac78-40ad-af7c-9791f8fe82cf tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.265146 May 16 15:15:53.622793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 40/82] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:53 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:53.630325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a7390a85-e0a0-4a69-b4fc-bf6727d8c5a4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:53.631007 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a7390a85-e0a0-4a69-b4fc-bf6727d8c5a4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:53.637426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7390a85-e0a0-4a69-b4fc-bf6727d8c5a4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.637959 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7390a85-e0a0-4a69-b4fc-bf6727d8c5a4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.638851 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7390a85-e0a0-4a69-b4fc-bf6727d8c5a4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.639444 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7390a85-e0a0-4a69-b4fc-bf6727d8c5a4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.656266 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-00f55057-be28-4448-a57a-49127f28b826 req-85efae6c-794f-4c9c-afaa-65e1870c11b8 service nova] Creating event network-vif-plugged:d3200ba0-e507-4313-a271-660316264ca6 for instance b8cc0b00-99f9-4486-b349-f60a0d2db023 on hv-cinder-79578 May 16 15:15:53.665419 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-00f55057-be28-4448-a57a-49127f28b826 req-85efae6c-794f-4c9c-afaa-65e1870c11b8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078085 May 16 15:15:53.671959 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 43/83] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:53.765102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0bc9ef08-a84b-49b8-a40a-4d4a627081f0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:53.765102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0bc9ef08-a84b-49b8-a40a-4d4a627081f0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:53.770796 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bc9ef08-a84b-49b8-a40a-4d4a627081f0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.772575 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bc9ef08-a84b-49b8-a40a-4d4a627081f0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.773523 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bc9ef08-a84b-49b8-a40a-4d4a627081f0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:53.774137 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bc9ef08-a84b-49b8-a40a-4d4a627081f0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:53.845201 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a7390a85-e0a0-4a69-b4fc-bf6727d8c5a4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:53.855156 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a7390a85-e0a0-4a69-b4fc-bf6727d8c5a4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.230966 May 16 15:15:53.856517 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 41/84] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:53 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:53.933650 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0bc9ef08-a84b-49b8-a40a-4d4a627081f0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:53.942507 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0bc9ef08-a84b-49b8-a40a-4d4a627081f0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.187247 May 16 15:15:53.943338 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 44/85] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:53 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:54.170885 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b5dc4bcf-9496-4a74-9927-74103da38b86 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:54.171502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b5dc4bcf-9496-4a74-9927-74103da38b86 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:54.177339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b5dc4bcf-9496-4a74-9927-74103da38b86 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.177935 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b5dc4bcf-9496-4a74-9927-74103da38b86 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.178729 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b5dc4bcf-9496-4a74-9927-74103da38b86 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.179162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b5dc4bcf-9496-4a74-9927-74103da38b86 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.308443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b5dc4bcf-9496-4a74-9927-74103da38b86 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:54.315821 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b5dc4bcf-9496-4a74-9927-74103da38b86 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.149354 May 16 15:15:54.316382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 42/86] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:54 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:54.638817 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-89b295b1-936a-44be-a08b-0880d970cb21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:54.639884 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-89b295b1-936a-44be-a08b-0880d970cb21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:54.645970 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89b295b1-936a-44be-a08b-0880d970cb21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.646578 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89b295b1-936a-44be-a08b-0880d970cb21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.647346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89b295b1-936a-44be-a08b-0880d970cb21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.647776 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89b295b1-936a-44be-a08b-0880d970cb21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.784081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-89b295b1-936a-44be-a08b-0880d970cb21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:54.793066 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-89b295b1-936a-44be-a08b-0880d970cb21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.158079 May 16 15:15:54.793693 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 45/87] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:54 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:54.874980 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a2f29d99-1f15-4f93-b61e-fff115b91588 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:54.875776 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a2f29d99-1f15-4f93-b61e-fff115b91588 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:54.882341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a2f29d99-1f15-4f93-b61e-fff115b91588 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.882799 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a2f29d99-1f15-4f93-b61e-fff115b91588 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.883584 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a2f29d99-1f15-4f93-b61e-fff115b91588 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.884057 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a2f29d99-1f15-4f93-b61e-fff115b91588 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.960735 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-68ea4aa5-0f83-4386-8476-51711a3984bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:54.961349 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-68ea4aa5-0f83-4386-8476-51711a3984bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:54.975508 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68ea4aa5-0f83-4386-8476-51711a3984bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.975959 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68ea4aa5-0f83-4386-8476-51711a3984bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:54.976734 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68ea4aa5-0f83-4386-8476-51711a3984bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:54.977169 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68ea4aa5-0f83-4386-8476-51711a3984bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:55.055506 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a2f29d99-1f15-4f93-b61e-fff115b91588 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:55.064347 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a2f29d99-1f15-4f93-b61e-fff115b91588 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.195313 May 16 15:15:55.064939 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 43/88] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:54 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:55.160063 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-68ea4aa5-0f83-4386-8476-51711a3984bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:55.168144 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-68ea4aa5-0f83-4386-8476-51711a3984bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.211478 May 16 15:15:55.175649 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 46/89] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:54 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:55.332681 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-92713f25-b200-43f4-bd65-409af2eff54b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:55.333288 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-92713f25-b200-43f4-bd65-409af2eff54b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:55.339205 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92713f25-b200-43f4-bd65-409af2eff54b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:55.339646 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92713f25-b200-43f4-bd65-409af2eff54b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:55.340407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92713f25-b200-43f4-bd65-409af2eff54b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:55.340838 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92713f25-b200-43f4-bd65-409af2eff54b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:55.493771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-92713f25-b200-43f4-bd65-409af2eff54b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:55.502443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-92713f25-b200-43f4-bd65-409af2eff54b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.173614 May 16 15:15:55.503245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 44/90] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:55 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:55.809139 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7e948e3b-8911-40bf-bd69-87ead8993855 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:55.809751 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7e948e3b-8911-40bf-bd69-87ead8993855 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:55.815757 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e948e3b-8911-40bf-bd69-87ead8993855 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:55.816331 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e948e3b-8911-40bf-bd69-87ead8993855 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:55.817324 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e948e3b-8911-40bf-bd69-87ead8993855 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:55.817762 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e948e3b-8911-40bf-bd69-87ead8993855 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:55.959183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7e948e3b-8911-40bf-bd69-87ead8993855 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:55.969504 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7e948e3b-8911-40bf-bd69-87ead8993855 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.164105 May 16 15:15:55.978188 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 47/91] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:55 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:56.082636 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7645e451-0ce5-435a-8f51-8692535cb4df tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:56.083027 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7645e451-0ce5-435a-8f51-8692535cb4df tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:56.088711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7645e451-0ce5-435a-8f51-8692535cb4df tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.089161 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7645e451-0ce5-435a-8f51-8692535cb4df tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.089902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7645e451-0ce5-435a-8f51-8692535cb4df tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.090392 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7645e451-0ce5-435a-8f51-8692535cb4df tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.184601 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a44e34f2-c89d-436b-a0e3-2d7cbbef2a6b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:56.185204 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a44e34f2-c89d-436b-a0e3-2d7cbbef2a6b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:56.191286 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a44e34f2-c89d-436b-a0e3-2d7cbbef2a6b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.191730 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a44e34f2-c89d-436b-a0e3-2d7cbbef2a6b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.192499 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a44e34f2-c89d-436b-a0e3-2d7cbbef2a6b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.193044 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a44e34f2-c89d-436b-a0e3-2d7cbbef2a6b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.222756 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7645e451-0ce5-435a-8f51-8692535cb4df tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:56.230454 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7645e451-0ce5-435a-8f51-8692535cb4df tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.152133 May 16 15:15:56.231159 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 45/92] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:56 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:56.324973 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a44e34f2-c89d-436b-a0e3-2d7cbbef2a6b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:56.332976 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a44e34f2-c89d-436b-a0e3-2d7cbbef2a6b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.152176 May 16 15:15:56.333538 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 48/93] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:56 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:56.520016 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cee0725e-77d5-4fbf-9d15-25b3593f911b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:56.520625 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cee0725e-77d5-4fbf-9d15-25b3593f911b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:56.526518 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cee0725e-77d5-4fbf-9d15-25b3593f911b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.526968 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cee0725e-77d5-4fbf-9d15-25b3593f911b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.527729 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cee0725e-77d5-4fbf-9d15-25b3593f911b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.528170 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cee0725e-77d5-4fbf-9d15-25b3593f911b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.655066 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cee0725e-77d5-4fbf-9d15-25b3593f911b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:56.662397 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cee0725e-77d5-4fbf-9d15-25b3593f911b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.146295 May 16 15:15:56.662956 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 46/94] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:56 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:56.986661 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6191a485-5039-4204-8955-4a80a0ab7678 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:56.987264 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6191a485-5039-4204-8955-4a80a0ab7678 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:56.993172 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6191a485-5039-4204-8955-4a80a0ab7678 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.993614 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6191a485-5039-4204-8955-4a80a0ab7678 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:56.994398 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6191a485-5039-4204-8955-4a80a0ab7678 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:56.994835 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6191a485-5039-4204-8955-4a80a0ab7678 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:57.127839 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6191a485-5039-4204-8955-4a80a0ab7678 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:57.135378 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6191a485-5039-4204-8955-4a80a0ab7678 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.152545 May 16 15:15:57.135979 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 49/95] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:56 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:57.247167 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d51cd152-68a0-4629-8005-9bfcf072dd22 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:57.247839 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d51cd152-68a0-4629-8005-9bfcf072dd22 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:57.254283 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d51cd152-68a0-4629-8005-9bfcf072dd22 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:57.254734 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d51cd152-68a0-4629-8005-9bfcf072dd22 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:57.255736 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d51cd152-68a0-4629-8005-9bfcf072dd22 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:57.255919 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d51cd152-68a0-4629-8005-9bfcf072dd22 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:57.350197 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-76bd3f74-db90-424c-a291-1025a90aaf22 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:57.350905 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-76bd3f74-db90-424c-a291-1025a90aaf22 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:57.356736 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76bd3f74-db90-424c-a291-1025a90aaf22 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:57.357177 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76bd3f74-db90-424c-a291-1025a90aaf22 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:57.357938 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76bd3f74-db90-424c-a291-1025a90aaf22 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:57.358393 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76bd3f74-db90-424c-a291-1025a90aaf22 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:57.382735 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d51cd152-68a0-4629-8005-9bfcf072dd22 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:57.390727 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d51cd152-68a0-4629-8005-9bfcf072dd22 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1315 microversion: 2.1 time: 0.147542 May 16 15:15:57.391629 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 47/96] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:57 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:57.485565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-76bd3f74-db90-424c-a291-1025a90aaf22 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:57.492856 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-76bd3f74-db90-424c-a291-1025a90aaf22 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.146565 May 16 15:15:57.493411 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 50/97] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:57 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:57.679788 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-655a8095-a156-4e7c-bc3c-efee8c20e87a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:57.680562 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-655a8095-a156-4e7c-bc3c-efee8c20e87a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:57.687139 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-655a8095-a156-4e7c-bc3c-efee8c20e87a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:57.687597 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-655a8095-a156-4e7c-bc3c-efee8c20e87a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:57.688341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-655a8095-a156-4e7c-bc3c-efee8c20e87a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:57.688774 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-655a8095-a156-4e7c-bc3c-efee8c20e87a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:57.821485 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-655a8095-a156-4e7c-bc3c-efee8c20e87a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:57.828842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-655a8095-a156-4e7c-bc3c-efee8c20e87a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.152860 May 16 15:15:57.829411 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 48/98] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:57 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:58.153235 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d93af002-2188-4463-9384-1cabf4490bbe tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:58.153991 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d93af002-2188-4463-9384-1cabf4490bbe tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:58.160715 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d93af002-2188-4463-9384-1cabf4490bbe tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.161244 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d93af002-2188-4463-9384-1cabf4490bbe tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.162187 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d93af002-2188-4463-9384-1cabf4490bbe tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.162625 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d93af002-2188-4463-9384-1cabf4490bbe tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.293153 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d93af002-2188-4463-9384-1cabf4490bbe tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:58.300467 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d93af002-2188-4463-9384-1cabf4490bbe tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.151686 May 16 15:15:58.301113 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 51/99] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:58 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:58.408463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d05ea6e5-b419-4f95-a696-f90cd76a4607 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:58.409311 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d05ea6e5-b419-4f95-a696-f90cd76a4607 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:58.415706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d05ea6e5-b419-4f95-a696-f90cd76a4607 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.416223 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d05ea6e5-b419-4f95-a696-f90cd76a4607 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.417065 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d05ea6e5-b419-4f95-a696-f90cd76a4607 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.417574 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d05ea6e5-b419-4f95-a696-f90cd76a4607 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.513217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1fb999ee-596e-48fb-b767-79a4ebe05e40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:58.514778 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1fb999ee-596e-48fb-b767-79a4ebe05e40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:58.522971 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fb999ee-596e-48fb-b767-79a4ebe05e40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.523859 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fb999ee-596e-48fb-b767-79a4ebe05e40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.525085 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fb999ee-596e-48fb-b767-79a4ebe05e40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.526200 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fb999ee-596e-48fb-b767-79a4ebe05e40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.559217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d05ea6e5-b419-4f95-a696-f90cd76a4607 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:58.567881 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d05ea6e5-b419-4f95-a696-f90cd76a4607 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1503 microversion: 2.1 time: 0.164134 May 16 15:15:58.568695 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 49/100] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:58 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:58.677995 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1fb999ee-596e-48fb-b767-79a4ebe05e40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:58.697148 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1fb999ee-596e-48fb-b767-79a4ebe05e40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.191192 May 16 15:15:58.697741 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 52/101] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:58 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:15:58.845882 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-88ec357e-b4b2-495d-a9fa-95e90211c238 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:58.847033 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-88ec357e-b4b2-495d-a9fa-95e90211c238 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:58.853989 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88ec357e-b4b2-495d-a9fa-95e90211c238 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.854751 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88ec357e-b4b2-495d-a9fa-95e90211c238 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.855771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88ec357e-b4b2-495d-a9fa-95e90211c238 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.856290 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88ec357e-b4b2-495d-a9fa-95e90211c238 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.924788 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-b234c74d-651f-48c8-94af-a34e2d8b7783 req-e0357b14-9dd8-4a92-96b2-a19a8fd2e864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd44422c-b621-4ad8-82ab-e5eeae7b2633", "name": "network-vif-plugged", "status": "completed", "tag": "a1eae8f4-b207-4d48-bdf5-dfab72b3d846"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:15:58.933450 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-b234c74d-651f-48c8-94af-a34e2d8b7783 req-e0357b14-9dd8-4a92-96b2-a19a8fd2e864 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:58.933929 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-b234c74d-651f-48c8-94af-a34e2d8b7783 req-e0357b14-9dd8-4a92-96b2-a19a8fd2e864 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:58.945730 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-b234c74d-651f-48c8-94af-a34e2d8b7783 req-e0357b14-9dd8-4a92-96b2-a19a8fd2e864 service nova] Creating event network-vif-plugged:a1eae8f4-b207-4d48-bdf5-dfab72b3d846 for instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 on hv-cinder-79578 May 16 15:15:58.951709 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-b234c74d-651f-48c8-94af-a34e2d8b7783 req-e0357b14-9dd8-4a92-96b2-a19a8fd2e864 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030376 May 16 15:15:58.952604 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 53/102] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:15:58.996733 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88ec357e-b4b2-495d-a9fa-95e90211c238 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:59.006173 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-88ec357e-b4b2-495d-a9fa-95e90211c238 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.164345 May 16 15:15:59.007073 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 50/103] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:58 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:59.323003 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-65c761ed-a103-419e-9839-e0df22948dd2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:59.330489 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-65c761ed-a103-419e-9839-e0df22948dd2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:59.332147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65c761ed-a103-419e-9839-e0df22948dd2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:59.333246 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65c761ed-a103-419e-9839-e0df22948dd2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:59.334634 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65c761ed-a103-419e-9839-e0df22948dd2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:59.335468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65c761ed-a103-419e-9839-e0df22948dd2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:59.502102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-65c761ed-a103-419e-9839-e0df22948dd2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:59.510758 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-65c761ed-a103-419e-9839-e0df22948dd2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.194216 May 16 15:15:59.511422 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 54/104] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:59 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:59.716270 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4c388b2c-5713-4459-8643-0e753bcc29a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:59.717108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4c388b2c-5713-4459-8643-0e753bcc29a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:15:59.723621 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4c388b2c-5713-4459-8643-0e753bcc29a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:59.724271 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4c388b2c-5713-4459-8643-0e753bcc29a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:59.725089 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4c388b2c-5713-4459-8643-0e753bcc29a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:15:59.725525 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4c388b2c-5713-4459-8643-0e753bcc29a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:15:59.879318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4c388b2c-5713-4459-8643-0e753bcc29a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:15:59.886895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4c388b2c-5713-4459-8643-0e753bcc29a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.174410 May 16 15:15:59.887458 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 51/105] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:15:59 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:00.023380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1e9d241b-d679-4f1f-9d7d-bdbdea67c92f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:00.023857 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1e9d241b-d679-4f1f-9d7d-bdbdea67c92f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:00.029798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e9d241b-d679-4f1f-9d7d-bdbdea67c92f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.030286 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e9d241b-d679-4f1f-9d7d-bdbdea67c92f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.031055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e9d241b-d679-4f1f-9d7d-bdbdea67c92f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.031658 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e9d241b-d679-4f1f-9d7d-bdbdea67c92f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.159621 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1e9d241b-d679-4f1f-9d7d-bdbdea67c92f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:00.166942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1e9d241b-d679-4f1f-9d7d-bdbdea67c92f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.147448 May 16 15:16:00.171614 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 55/106] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:00 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:00.527915 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-867da822-df6a-4889-b4f5-1cde331c82d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:00.528600 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-867da822-df6a-4889-b4f5-1cde331c82d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:00.536446 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-867da822-df6a-4889-b4f5-1cde331c82d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.537102 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-867da822-df6a-4889-b4f5-1cde331c82d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.537992 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-867da822-df6a-4889-b4f5-1cde331c82d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.538638 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-867da822-df6a-4889-b4f5-1cde331c82d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.707738 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-867da822-df6a-4889-b4f5-1cde331c82d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:00.715721 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-867da822-df6a-4889-b4f5-1cde331c82d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.191730 May 16 15:16:00.716400 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 52/107] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:00 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:00.771793 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ca53b512-563a-4a2f-9b22-f94a3746d6bb tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a07d7785-7e97-4f21-9763-8ee9b400b5a1"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:00.773145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ca53b512-563a-4a2f-9b22-f94a3746d6bb tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:00.780480 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca53b512-563a-4a2f-9b22-f94a3746d6bb tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.781099 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca53b512-563a-4a2f-9b22-f94a3746d6bb tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.782000 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca53b512-563a-4a2f-9b22-f94a3746d6bb tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.782473 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca53b512-563a-4a2f-9b22-f94a3746d6bb tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.904956 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ff394a09-753d-4a24-8020-04cbcbeaf0cf tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:00.904956 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ff394a09-753d-4a24-8020-04cbcbeaf0cf tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:00.911481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff394a09-753d-4a24-8020-04cbcbeaf0cf tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.912352 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff394a09-753d-4a24-8020-04cbcbeaf0cf tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:00.912971 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff394a09-753d-4a24-8020-04cbcbeaf0cf tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:00.913497 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff394a09-753d-4a24-8020-04cbcbeaf0cf tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:01.055104 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ff394a09-753d-4a24-8020-04cbcbeaf0cf tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:01.063071 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ff394a09-753d-4a24-8020-04cbcbeaf0cf tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.163046 May 16 15:16:01.063635 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 53/108] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:00 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:01.067893 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-df1109c6-dc02-4eb4-a481-10ae282ae4ad req-46cd0886-3960-418a-9ff1-3f0da7d7f604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e68f7e-80df-470a-869e-8c625ab4709c", "name": "network-vif-plugged", "status": "completed", "tag": "c2d12348-be99-4d8a-833b-0746887f6b11"}, {"server_uuid": "766a2d7d-3279-4c55-9dfb-29746e7fd0f0", "name": "network-vif-plugged", "status": "completed", "tag": "478148b0-c270-4a3b-8603-9ce967e01679"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:01.077154 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-df1109c6-dc02-4eb4-a481-10ae282ae4ad req-46cd0886-3960-418a-9ff1-3f0da7d7f604 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:01.077599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-df1109c6-dc02-4eb4-a481-10ae282ae4ad req-46cd0886-3960-418a-9ff1-3f0da7d7f604 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:01.090561 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-df1109c6-dc02-4eb4-a481-10ae282ae4ad req-46cd0886-3960-418a-9ff1-3f0da7d7f604 service nova] Creating event network-vif-plugged:c2d12348-be99-4d8a-833b-0746887f6b11 for instance f3e68f7e-80df-470a-869e-8c625ab4709c on hv-cinder-79578 May 16 15:16:01.091070 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-df1109c6-dc02-4eb4-a481-10ae282ae4ad req-46cd0886-3960-418a-9ff1-3f0da7d7f604 service nova] Creating event network-vif-plugged:478148b0-c270-4a3b-8603-9ce967e01679 for instance 766a2d7d-3279-4c55-9dfb-29746e7fd0f0 on hv-cinder-79578 May 16 15:16:01.097412 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-df1109c6-dc02-4eb4-a481-10ae282ae4ad req-46cd0886-3960-418a-9ff1-3f0da7d7f604 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032707 May 16 15:16:01.097993 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 54/109] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:01.184767 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9ba13c52-2c73-4375-b6cd-23de4ad70484 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:01.185937 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9ba13c52-2c73-4375-b6cd-23de4ad70484 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:01.192182 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ba13c52-2c73-4375-b6cd-23de4ad70484 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:01.192628 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ba13c52-2c73-4375-b6cd-23de4ad70484 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:01.193398 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ba13c52-2c73-4375-b6cd-23de4ad70484 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:01.193832 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ba13c52-2c73-4375-b6cd-23de4ad70484 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:01.324924 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9ba13c52-2c73-4375-b6cd-23de4ad70484 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:01.332838 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9ba13c52-2c73-4375-b6cd-23de4ad70484 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.152265 May 16 15:16:01.333414 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 55/110] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:01 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:01.732761 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e76fd5e8-6a99-4b58-a9c0-158e2a2b326c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:01.733634 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e76fd5e8-6a99-4b58-a9c0-158e2a2b326c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:01.740107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e76fd5e8-6a99-4b58-a9c0-158e2a2b326c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:01.740728 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e76fd5e8-6a99-4b58-a9c0-158e2a2b326c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:01.741700 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e76fd5e8-6a99-4b58-a9c0-158e2a2b326c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:01.742316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e76fd5e8-6a99-4b58-a9c0-158e2a2b326c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:01.945712 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e76fd5e8-6a99-4b58-a9c0-158e2a2b326c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:01.954549 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e76fd5e8-6a99-4b58-a9c0-158e2a2b326c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.225491 May 16 15:16:01.955181 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 56/111] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:01 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:02.080561 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fb76d1b1-5f9c-456e-8d1b-cc8ce77efc30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:02.081246 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fb76d1b1-5f9c-456e-8d1b-cc8ce77efc30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:02.088598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb76d1b1-5f9c-456e-8d1b-cc8ce77efc30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:02.089046 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb76d1b1-5f9c-456e-8d1b-cc8ce77efc30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:02.089829 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb76d1b1-5f9c-456e-8d1b-cc8ce77efc30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:02.090290 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb76d1b1-5f9c-456e-8d1b-cc8ce77efc30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:02.221421 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fb76d1b1-5f9c-456e-8d1b-cc8ce77efc30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:02.228667 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fb76d1b1-5f9c-456e-8d1b-cc8ce77efc30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.151876 May 16 15:16:02.229261 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 57/112] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:02 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:02.349654 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3ddb5de8-e0f4-44f9-93c5-6ce75e904111 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:02.350340 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3ddb5de8-e0f4-44f9-93c5-6ce75e904111 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:02.356311 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ddb5de8-e0f4-44f9-93c5-6ce75e904111 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:02.356755 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ddb5de8-e0f4-44f9-93c5-6ce75e904111 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:02.357721 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ddb5de8-e0f4-44f9-93c5-6ce75e904111 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:02.358332 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ddb5de8-e0f4-44f9-93c5-6ce75e904111 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:02.511900 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3ddb5de8-e0f4-44f9-93c5-6ce75e904111 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:02.521940 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3ddb5de8-e0f4-44f9-93c5-6ce75e904111 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.175876 May 16 15:16:02.545843 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 58/113] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:02 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:02.970407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a316ee3b-9f6b-4e85-974b-aabaa6d0c488 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:02.971015 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a316ee3b-9f6b-4e85-974b-aabaa6d0c488 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:02.976867 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a316ee3b-9f6b-4e85-974b-aabaa6d0c488 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:02.977314 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a316ee3b-9f6b-4e85-974b-aabaa6d0c488 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:02.978096 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a316ee3b-9f6b-4e85-974b-aabaa6d0c488 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:02.978533 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a316ee3b-9f6b-4e85-974b-aabaa6d0c488 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:03.124093 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a316ee3b-9f6b-4e85-974b-aabaa6d0c488 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:03.131586 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a316ee3b-9f6b-4e85-974b-aabaa6d0c488 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.164913 May 16 15:16:03.133712 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 59/114] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:02 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:03.245659 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2a092830-d3ea-4ddf-803f-167feca5e2ea tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:03.246371 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2a092830-d3ea-4ddf-803f-167feca5e2ea tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:03.252369 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2a092830-d3ea-4ddf-803f-167feca5e2ea tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:03.252886 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2a092830-d3ea-4ddf-803f-167feca5e2ea tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:03.253783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2a092830-d3ea-4ddf-803f-167feca5e2ea tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:03.254249 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2a092830-d3ea-4ddf-803f-167feca5e2ea tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:03.389376 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2a092830-d3ea-4ddf-803f-167feca5e2ea tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:03.401474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2a092830-d3ea-4ddf-803f-167feca5e2ea tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.159741 May 16 15:16:03.402084 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 60/115] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:03 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:03.548902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4d1fbe08-64c6-41ea-b2de-273c49af8cb9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:03.549514 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4d1fbe08-64c6-41ea-b2de-273c49af8cb9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:03.555349 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d1fbe08-64c6-41ea-b2de-273c49af8cb9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:03.555806 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d1fbe08-64c6-41ea-b2de-273c49af8cb9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:03.558135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d1fbe08-64c6-41ea-b2de-273c49af8cb9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:03.558592 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d1fbe08-64c6-41ea-b2de-273c49af8cb9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:03.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4d1fbe08-64c6-41ea-b2de-273c49af8cb9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:03.706695 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4d1fbe08-64c6-41ea-b2de-273c49af8cb9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1365 microversion: 2.1 time: 0.161627 May 16 15:16:03.714097 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 61/116] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:03 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:04.148316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-88267908-eb17-4473-9dbd-6b4b4f2f90fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:04.149018 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-88267908-eb17-4473-9dbd-6b4b4f2f90fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:04.154978 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88267908-eb17-4473-9dbd-6b4b4f2f90fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.155638 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88267908-eb17-4473-9dbd-6b4b4f2f90fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.156587 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88267908-eb17-4473-9dbd-6b4b4f2f90fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.157022 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88267908-eb17-4473-9dbd-6b4b4f2f90fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.296250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88267908-eb17-4473-9dbd-6b4b4f2f90fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:04.305720 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-88267908-eb17-4473-9dbd-6b4b4f2f90fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.161033 May 16 15:16:04.306470 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 62/117] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:04 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:04.420260 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f42cd862-c71a-47b4-bcb3-d38f683d6a25 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:04.420888 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f42cd862-c71a-47b4-bcb3-d38f683d6a25 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:04.427083 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f42cd862-c71a-47b4-bcb3-d38f683d6a25 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.427565 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f42cd862-c71a-47b4-bcb3-d38f683d6a25 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.428476 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f42cd862-c71a-47b4-bcb3-d38f683d6a25 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.428925 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f42cd862-c71a-47b4-bcb3-d38f683d6a25 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.648861 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f42cd862-c71a-47b4-bcb3-d38f683d6a25 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:04.660117 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f42cd862-c71a-47b4-bcb3-d38f683d6a25 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.244750 May 16 15:16:04.660775 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 63/118] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:04 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:04.723410 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cdb6cc92-8206-4b00-a8b5-d3f856c9632d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:04.723966 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cdb6cc92-8206-4b00-a8b5-d3f856c9632d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:04.735129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cdb6cc92-8206-4b00-a8b5-d3f856c9632d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.735129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cdb6cc92-8206-4b00-a8b5-d3f856c9632d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.735129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cdb6cc92-8206-4b00-a8b5-d3f856c9632d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.735129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cdb6cc92-8206-4b00-a8b5-d3f856c9632d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.895942 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cdb6cc92-8206-4b00-a8b5-d3f856c9632d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:04.904341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cdb6cc92-8206-4b00-a8b5-d3f856c9632d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1555 microversion: 2.1 time: 0.184255 May 16 15:16:04.904930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 64/119] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:04 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:04.926298 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d3a1f0ca-9a50-4ef4-a730-949548a32e53 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:04.926900 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d3a1f0ca-9a50-4ef4-a730-949548a32e53 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:04.932812 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3a1f0ca-9a50-4ef4-a730-949548a32e53 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.933245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3a1f0ca-9a50-4ef4-a730-949548a32e53 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.934315 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3a1f0ca-9a50-4ef4-a730-949548a32e53 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:04.934748 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3a1f0ca-9a50-4ef4-a730-949548a32e53 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:04.937290 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ca53b512-563a-4a2f-9b22-f94a3746d6bb tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "POST /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.169716 May 16 15:16:04.937994 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 56/120] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:16:00 2022] POST /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7/os-volume_attachments => generated 194 bytes in 4171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:05.095503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d3a1f0ca-9a50-4ef4-a730-949548a32e53 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173010 May 16 15:16:05.096239 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 65/121] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 16 15:16:04 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:16:05.327769 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0293600a-c968-4ddc-a5cb-db3b70531d1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:05.327769 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0293600a-c968-4ddc-a5cb-db3b70531d1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:05.332801 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0293600a-c968-4ddc-a5cb-db3b70531d1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:05.333370 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0293600a-c968-4ddc-a5cb-db3b70531d1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:05.334312 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0293600a-c968-4ddc-a5cb-db3b70531d1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:05.334873 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0293600a-c968-4ddc-a5cb-db3b70531d1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:05.677376 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4457a69d-6b50-4d89-8af8-cd864c85fb53 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:05.678009 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4457a69d-6b50-4d89-8af8-cd864c85fb53 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:05.684064 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4457a69d-6b50-4d89-8af8-cd864c85fb53 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:05.684517 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4457a69d-6b50-4d89-8af8-cd864c85fb53 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:05.688969 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4457a69d-6b50-4d89-8af8-cd864c85fb53 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:05.689539 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4457a69d-6b50-4d89-8af8-cd864c85fb53 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:05.810878 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0293600a-c968-4ddc-a5cb-db3b70531d1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:05.822351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0293600a-c968-4ddc-a5cb-db3b70531d1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.502242 May 16 15:16:05.824333 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 57/122] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:05 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:05.885783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4457a69d-6b50-4d89-8af8-cd864c85fb53 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:05.895489 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4457a69d-6b50-4d89-8af8-cd864c85fb53 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1361 microversion: 2.1 time: 0.221821 May 16 15:16:05.897166 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 66/123] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:05 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:06.674819 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-cb7f0bba-a646-4612-b6af-23da3ba16339 req-a87ba42b-90df-420f-b024-c4febc80de1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd44422c-b621-4ad8-82ab-e5eeae7b2633", "tag": "a1eae8f4-b207-4d48-bdf5-dfab72b3d846"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:06.684970 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-cb7f0bba-a646-4612-b6af-23da3ba16339 req-a87ba42b-90df-420f-b024-c4febc80de1f service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:06.685514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-cb7f0bba-a646-4612-b6af-23da3ba16339 req-a87ba42b-90df-420f-b024-c4febc80de1f service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:06.701347 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-cb7f0bba-a646-4612-b6af-23da3ba16339 req-a87ba42b-90df-420f-b024-c4febc80de1f service nova] Creating event network-changed:a1eae8f4-b207-4d48-bdf5-dfab72b3d846 for instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 on hv-cinder-79578 May 16 15:16:06.706606 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-cb7f0bba-a646-4612-b6af-23da3ba16339 req-a87ba42b-90df-420f-b024-c4febc80de1f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035798 May 16 15:16:06.710547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 58/124] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:16:06.840194 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a84fe39e-2ebf-4503-b252-c43b63fe57b7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:06.840798 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a84fe39e-2ebf-4503-b252-c43b63fe57b7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:06.847901 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a84fe39e-2ebf-4503-b252-c43b63fe57b7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:06.848566 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a84fe39e-2ebf-4503-b252-c43b63fe57b7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:06.849497 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a84fe39e-2ebf-4503-b252-c43b63fe57b7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:06.858145 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a84fe39e-2ebf-4503-b252-c43b63fe57b7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:06.923116 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1eb6b049-01d0-4881-86d1-8ff623f3024c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:06.924039 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1eb6b049-01d0-4881-86d1-8ff623f3024c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:06.936178 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eb6b049-01d0-4881-86d1-8ff623f3024c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:06.937684 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eb6b049-01d0-4881-86d1-8ff623f3024c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:06.938742 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eb6b049-01d0-4881-86d1-8ff623f3024c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:06.939524 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eb6b049-01d0-4881-86d1-8ff623f3024c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:07.111003 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a84fe39e-2ebf-4503-b252-c43b63fe57b7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:07.120579 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a84fe39e-2ebf-4503-b252-c43b63fe57b7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1322 microversion: 2.1 time: 0.283879 May 16 15:16:07.121693 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 67/125] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:06 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:07.190237 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1eb6b049-01d0-4881-86d1-8ff623f3024c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:07.199618 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1eb6b049-01d0-4881-86d1-8ff623f3024c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1547 microversion: 2.1 time: 0.289984 May 16 15:16:07.201165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 59/126] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:06 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1547 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:07.218401 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5c05142d-0290-4dd2-a03f-99a83091ede8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:07.219287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5c05142d-0290-4dd2-a03f-99a83091ede8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:07.225660 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c05142d-0290-4dd2-a03f-99a83091ede8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:07.226382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c05142d-0290-4dd2-a03f-99a83091ede8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:07.229097 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c05142d-0290-4dd2-a03f-99a83091ede8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:07.229097 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c05142d-0290-4dd2-a03f-99a83091ede8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:07.321000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5c05142d-0290-4dd2-a03f-99a83091ede8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106713 May 16 15:16:07.321649 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 68/127] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 16 15:16:07 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:08.140814 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5fb0b0cd-c7d0-48a9-be94-ae6902056b9d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:08.144885 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5fb0b0cd-c7d0-48a9-be94-ae6902056b9d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:08.155997 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fb0b0cd-c7d0-48a9-be94-ae6902056b9d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:08.156980 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fb0b0cd-c7d0-48a9-be94-ae6902056b9d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:08.158185 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fb0b0cd-c7d0-48a9-be94-ae6902056b9d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:08.159595 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fb0b0cd-c7d0-48a9-be94-ae6902056b9d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:08.328963 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5fb0b0cd-c7d0-48a9-be94-ae6902056b9d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:08.337849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5fb0b0cd-c7d0-48a9-be94-ae6902056b9d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1517 microversion: 2.1 time: 0.202807 May 16 15:16:08.338478 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 60/128] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:08 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:08.360969 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3e397938-5804-46fa-9b74-3bff882d6f8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:08.361977 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3e397938-5804-46fa-9b74-3bff882d6f8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:08.367942 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3e397938-5804-46fa-9b74-3bff882d6f8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:08.368388 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3e397938-5804-46fa-9b74-3bff882d6f8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:08.369135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3e397938-5804-46fa-9b74-3bff882d6f8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:08.369566 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3e397938-5804-46fa-9b74-3bff882d6f8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:08.392354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-3e397938-5804-46fa-9b74-3bff882d6f8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lazy-loading 'flavor' on Instance uuid 766a2d7d-3279-4c55-9dfb-29746e7fd0f0 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:16:08.687409 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3e397938-5804-46fa-9b74-3bff882d6f8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "POST /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0/action" status: 200 len: 32 microversion: 2.1 time: 0.330510 May 16 15:16:08.688106 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 69/129] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:16:08 2022] POST /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0/action => generated 32 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:16:08.706788 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f128739c-2bde-45b0-9370-31860d99fe61 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:08.707869 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f128739c-2bde-45b0-9370-31860d99fe61 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:08.717996 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f128739c-2bde-45b0-9370-31860d99fe61 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:08.718800 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f128739c-2bde-45b0-9370-31860d99fe61 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:08.719573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f128739c-2bde-45b0-9370-31860d99fe61 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:08.720323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f128739c-2bde-45b0-9370-31860d99fe61 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:08.857280 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f128739c-2bde-45b0-9370-31860d99fe61 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:08.865460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f128739c-2bde-45b0-9370-31860d99fe61 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.162824 May 16 15:16:08.866501 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 61/130] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:08 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:08.896289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-ef2fa703-6fe4-4117-9d11-75cc02c36233 req-f6807352-9a59-4949-b995-4df32637415a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e68f7e-80df-470a-869e-8c625ab4709c", "tag": "c2d12348-be99-4d8a-833b-0746887f6b11"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:08.904477 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ef2fa703-6fe4-4117-9d11-75cc02c36233 req-f6807352-9a59-4949-b995-4df32637415a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:08.904918 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ef2fa703-6fe4-4117-9d11-75cc02c36233 req-f6807352-9a59-4949-b995-4df32637415a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:08.919729 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-ef2fa703-6fe4-4117-9d11-75cc02c36233 req-f6807352-9a59-4949-b995-4df32637415a service nova] Creating event network-changed:c2d12348-be99-4d8a-833b-0746887f6b11 for instance f3e68f7e-80df-470a-869e-8c625ab4709c on hv-cinder-79578 May 16 15:16:08.924474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-ef2fa703-6fe4-4117-9d11-75cc02c36233 req-f6807352-9a59-4949-b995-4df32637415a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032322 May 16 15:16:08.925073 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 70/131] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:09.882494 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2e15afc4-4e52-44a2-aee7-9b81ae197e39 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:09.883015 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2e15afc4-4e52-44a2-aee7-9b81ae197e39 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:09.889313 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e15afc4-4e52-44a2-aee7-9b81ae197e39 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:09.889961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e15afc4-4e52-44a2-aee7-9b81ae197e39 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:09.890932 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e15afc4-4e52-44a2-aee7-9b81ae197e39 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:09.891370 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e15afc4-4e52-44a2-aee7-9b81ae197e39 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:10.041549 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2e15afc4-4e52-44a2-aee7-9b81ae197e39 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:10.050211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2e15afc4-4e52-44a2-aee7-9b81ae197e39 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.171361 May 16 15:16:10.050921 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 62/132] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:09 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:11.068315 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4599f4d3-ae33-434d-9ce1-afd382fb4fd7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:11.069460 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4599f4d3-ae33-434d-9ce1-afd382fb4fd7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:11.078394 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4599f4d3-ae33-434d-9ce1-afd382fb4fd7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:11.082201 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4599f4d3-ae33-434d-9ce1-afd382fb4fd7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:11.083035 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4599f4d3-ae33-434d-9ce1-afd382fb4fd7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:11.083687 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4599f4d3-ae33-434d-9ce1-afd382fb4fd7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:11.275772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4599f4d3-ae33-434d-9ce1-afd382fb4fd7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:11.283273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4599f4d3-ae33-434d-9ce1-afd382fb4fd7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.220292 May 16 15:16:11.283843 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 71/133] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:11 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:12.300450 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-631085dd-daf0-40ad-9a0b-2c0b2ff84d62 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:12.301055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-631085dd-daf0-40ad-9a0b-2c0b2ff84d62 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:12.307671 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-631085dd-daf0-40ad-9a0b-2c0b2ff84d62 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:12.308113 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-631085dd-daf0-40ad-9a0b-2c0b2ff84d62 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:12.308873 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-631085dd-daf0-40ad-9a0b-2c0b2ff84d62 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:12.309351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-631085dd-daf0-40ad-9a0b-2c0b2ff84d62 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:12.437114 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-631085dd-daf0-40ad-9a0b-2c0b2ff84d62 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:12.444379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-631085dd-daf0-40ad-9a0b-2c0b2ff84d62 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.147831 May 16 15:16:12.444938 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 63/134] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:12 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:13.460643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8e6d4860-c432-4d21-b4f0-d2061f15ffb0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:13.461248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8e6d4860-c432-4d21-b4f0-d2061f15ffb0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:13.467171 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e6d4860-c432-4d21-b4f0-d2061f15ffb0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:13.467623 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e6d4860-c432-4d21-b4f0-d2061f15ffb0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:13.468407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e6d4860-c432-4d21-b4f0-d2061f15ffb0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:13.468849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e6d4860-c432-4d21-b4f0-d2061f15ffb0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:13.597360 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8e6d4860-c432-4d21-b4f0-d2061f15ffb0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:13.604810 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8e6d4860-c432-4d21-b4f0-d2061f15ffb0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.148046 May 16 15:16:13.605374 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 72/135] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:13 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:14.622568 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-59a75550-c73e-4085-82c8-e8b725f82c8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:14.623309 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-59a75550-c73e-4085-82c8-e8b725f82c8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:14.630678 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59a75550-c73e-4085-82c8-e8b725f82c8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:14.631126 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59a75550-c73e-4085-82c8-e8b725f82c8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:14.631934 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59a75550-c73e-4085-82c8-e8b725f82c8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:14.632370 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59a75550-c73e-4085-82c8-e8b725f82c8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:15.019169 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-59a75550-c73e-4085-82c8-e8b725f82c8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:15.026374 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-59a75550-c73e-4085-82c8-e8b725f82c8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.408149 May 16 15:16:15.026944 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 64/136] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:14 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:16.043039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2e9bf141-3c34-4625-858b-e33c472a4774 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:16.048235 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2e9bf141-3c34-4625-858b-e33c472a4774 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:16.050199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e9bf141-3c34-4625-858b-e33c472a4774 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:16.050640 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e9bf141-3c34-4625-858b-e33c472a4774 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:16.051404 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e9bf141-3c34-4625-858b-e33c472a4774 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:16.051830 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e9bf141-3c34-4625-858b-e33c472a4774 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:16.186551 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2e9bf141-3c34-4625-858b-e33c472a4774 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:16.195873 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2e9bf141-3c34-4625-858b-e33c472a4774 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.155669 May 16 15:16:16.196267 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 73/137] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:16 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:17.212597 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-15b6a5f8-48a5-47da-ba96-237dd5a0d8e2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:17.213108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-15b6a5f8-48a5-47da-ba96-237dd5a0d8e2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:17.220084 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15b6a5f8-48a5-47da-ba96-237dd5a0d8e2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:17.220511 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15b6a5f8-48a5-47da-ba96-237dd5a0d8e2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:17.221273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15b6a5f8-48a5-47da-ba96-237dd5a0d8e2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:17.221709 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15b6a5f8-48a5-47da-ba96-237dd5a0d8e2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:17.348984 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-15b6a5f8-48a5-47da-ba96-237dd5a0d8e2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:17.356562 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-15b6a5f8-48a5-47da-ba96-237dd5a0d8e2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.147861 May 16 15:16:17.357122 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 65/138] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:17 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:18.372794 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d37cf567-28f5-4d3d-ad10-0f3c484fd3fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:18.373392 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d37cf567-28f5-4d3d-ad10-0f3c484fd3fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:18.379179 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d37cf567-28f5-4d3d-ad10-0f3c484fd3fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:18.379619 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d37cf567-28f5-4d3d-ad10-0f3c484fd3fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:18.380368 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d37cf567-28f5-4d3d-ad10-0f3c484fd3fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:18.380795 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d37cf567-28f5-4d3d-ad10-0f3c484fd3fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:18.504041 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d37cf567-28f5-4d3d-ad10-0f3c484fd3fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:18.511228 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d37cf567-28f5-4d3d-ad10-0f3c484fd3fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.142206 May 16 15:16:18.511854 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 74/139] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:18 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:19.527509 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7535a158-ca93-4ce0-ba7c-75e7f3fde601 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:19.528067 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7535a158-ca93-4ce0-ba7c-75e7f3fde601 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:19.534488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7535a158-ca93-4ce0-ba7c-75e7f3fde601 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:19.534934 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7535a158-ca93-4ce0-ba7c-75e7f3fde601 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:19.535691 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7535a158-ca93-4ce0-ba7c-75e7f3fde601 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:19.536122 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7535a158-ca93-4ce0-ba7c-75e7f3fde601 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:19.663887 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7535a158-ca93-4ce0-ba7c-75e7f3fde601 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:19.671767 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7535a158-ca93-4ce0-ba7c-75e7f3fde601 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.148169 May 16 15:16:19.672336 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 66/140] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:19 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:20.688780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2585ed5e-cee9-440c-b654-4da8d2e03ac3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:20.689350 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2585ed5e-cee9-440c-b654-4da8d2e03ac3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:20.695321 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2585ed5e-cee9-440c-b654-4da8d2e03ac3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:20.695771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2585ed5e-cee9-440c-b654-4da8d2e03ac3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:20.696531 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2585ed5e-cee9-440c-b654-4da8d2e03ac3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:20.696967 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2585ed5e-cee9-440c-b654-4da8d2e03ac3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:20.823112 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2585ed5e-cee9-440c-b654-4da8d2e03ac3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:20.830441 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2585ed5e-cee9-440c-b654-4da8d2e03ac3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.146003 May 16 15:16:20.830998 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 75/141] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:20 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:21.847379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-77225c1a-1fbd-43b6-a38a-ab3235a8f381 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:21.848064 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-77225c1a-1fbd-43b6-a38a-ab3235a8f381 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:21.854038 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77225c1a-1fbd-43b6-a38a-ab3235a8f381 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:21.854498 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77225c1a-1fbd-43b6-a38a-ab3235a8f381 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:21.855336 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77225c1a-1fbd-43b6-a38a-ab3235a8f381 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:21.855761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77225c1a-1fbd-43b6-a38a-ab3235a8f381 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:21.984694 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-77225c1a-1fbd-43b6-a38a-ab3235a8f381 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:21.992181 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-77225c1a-1fbd-43b6-a38a-ab3235a8f381 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.148597 May 16 15:16:21.992743 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 67/142] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:21 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:23.008522 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e560bf46-ba5c-4b1b-9a25-e3c9c0a7c167 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:23.009125 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e560bf46-ba5c-4b1b-9a25-e3c9c0a7c167 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:23.015806 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e560bf46-ba5c-4b1b-9a25-e3c9c0a7c167 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:23.016406 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e560bf46-ba5c-4b1b-9a25-e3c9c0a7c167 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:23.017175 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e560bf46-ba5c-4b1b-9a25-e3c9c0a7c167 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:23.017886 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e560bf46-ba5c-4b1b-9a25-e3c9c0a7c167 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:23.149569 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e560bf46-ba5c-4b1b-9a25-e3c9c0a7c167 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:23.157584 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e560bf46-ba5c-4b1b-9a25-e3c9c0a7c167 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.152828 May 16 15:16:23.158144 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 76/143] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:23 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:24.174084 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-384b6f80-19be-4916-bd76-3061a8085b8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:24.174638 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-384b6f80-19be-4916-bd76-3061a8085b8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:24.180916 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-384b6f80-19be-4916-bd76-3061a8085b8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:24.181363 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-384b6f80-19be-4916-bd76-3061a8085b8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:24.182158 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-384b6f80-19be-4916-bd76-3061a8085b8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:24.182589 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-384b6f80-19be-4916-bd76-3061a8085b8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:24.314096 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-384b6f80-19be-4916-bd76-3061a8085b8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:24.322143 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-384b6f80-19be-4916-bd76-3061a8085b8d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.151904 May 16 15:16:24.322719 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 68/144] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:24 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:25.339550 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b541af27-4ea7-4d04-a706-b52c748396d1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:25.340242 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b541af27-4ea7-4d04-a706-b52c748396d1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:25.346635 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b541af27-4ea7-4d04-a706-b52c748396d1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:25.347080 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b541af27-4ea7-4d04-a706-b52c748396d1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:25.347842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b541af27-4ea7-4d04-a706-b52c748396d1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:25.348305 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b541af27-4ea7-4d04-a706-b52c748396d1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:25.484304 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b541af27-4ea7-4d04-a706-b52c748396d1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:25.492102 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b541af27-4ea7-4d04-a706-b52c748396d1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.156556 May 16 15:16:25.493565 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 77/145] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:25 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:25.788423 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b94f2eff-8e33-405b-b1b7-e4ec11cc2a1a tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:25.788880 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b94f2eff-8e33-405b-b1b7-e4ec11cc2a1a tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:25.795828 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b94f2eff-8e33-405b-b1b7-e4ec11cc2a1a tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:25.796273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b94f2eff-8e33-405b-b1b7-e4ec11cc2a1a tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:25.797035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b94f2eff-8e33-405b-b1b7-e4ec11cc2a1a tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:25.797630 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b94f2eff-8e33-405b-b1b7-e4ec11cc2a1a tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:25.824624 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b94f2eff-8e33-405b-b1b7-e4ec11cc2a1a tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:16:26.245851 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b94f2eff-8e33-405b-b1b7-e4ec11cc2a1a tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "DELETE /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 204 len: 0 microversion: 2.1 time: 0.461164 May 16 15:16:26.246375 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 69/146] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:16:25 2022] DELETE /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:16:26.255496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5bc626d1-6bf0-42cb-955c-84377f6f0c5b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:26.256128 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5bc626d1-6bf0-42cb-955c-84377f6f0c5b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:26.261983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5bc626d1-6bf0-42cb-955c-84377f6f0c5b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:26.262636 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5bc626d1-6bf0-42cb-955c-84377f6f0c5b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:26.263394 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5bc626d1-6bf0-42cb-955c-84377f6f0c5b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:26.263824 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5bc626d1-6bf0-42cb-955c-84377f6f0c5b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:26.408907 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5bc626d1-6bf0-42cb-955c-84377f6f0c5b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:26.417623 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5bc626d1-6bf0-42cb-955c-84377f6f0c5b tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1555 microversion: 2.1 time: 0.166865 May 16 15:16:26.419941 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 78/147] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:26 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:26.510826 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a4690c41-c432-450e-a08c-e4aa6436daa8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:26.511782 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a4690c41-c432-450e-a08c-e4aa6436daa8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:26.518430 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4690c41-c432-450e-a08c-e4aa6436daa8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:26.518813 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4690c41-c432-450e-a08c-e4aa6436daa8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:26.519581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4690c41-c432-450e-a08c-e4aa6436daa8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:26.520013 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4690c41-c432-450e-a08c-e4aa6436daa8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:26.661394 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a4690c41-c432-450e-a08c-e4aa6436daa8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:26.669462 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a4690c41-c432-450e-a08c-e4aa6436daa8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.163143 May 16 15:16:26.670025 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 70/148] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:26 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:27.434945 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1c5da473-b8bb-474f-9894-57c2f1cc110d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:27.435545 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1c5da473-b8bb-474f-9894-57c2f1cc110d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:27.441303 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c5da473-b8bb-474f-9894-57c2f1cc110d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:27.441749 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c5da473-b8bb-474f-9894-57c2f1cc110d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:27.442547 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c5da473-b8bb-474f-9894-57c2f1cc110d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:27.442976 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c5da473-b8bb-474f-9894-57c2f1cc110d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:27.568523 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1c5da473-b8bb-474f-9894-57c2f1cc110d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:27.578007 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1c5da473-b8bb-474f-9894-57c2f1cc110d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1555 microversion: 2.1 time: 0.146803 May 16 15:16:27.578621 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 79/149] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:27 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:27.686530 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f23d8392-b171-4e60-83dc-f799a76589d2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:27.687053 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f23d8392-b171-4e60-83dc-f799a76589d2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:27.693201 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f23d8392-b171-4e60-83dc-f799a76589d2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:27.693638 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f23d8392-b171-4e60-83dc-f799a76589d2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:27.694414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f23d8392-b171-4e60-83dc-f799a76589d2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:27.695094 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f23d8392-b171-4e60-83dc-f799a76589d2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:27.876883 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f23d8392-b171-4e60-83dc-f799a76589d2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:27.884294 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f23d8392-b171-4e60-83dc-f799a76589d2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.202272 May 16 15:16:27.884858 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 71/150] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:27 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:28.595338 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0704f7b6-0be8-4a00-9785-0cc157ecb802 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:28.595848 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0704f7b6-0be8-4a00-9785-0cc157ecb802 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:28.601659 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0704f7b6-0be8-4a00-9785-0cc157ecb802 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:28.602233 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0704f7b6-0be8-4a00-9785-0cc157ecb802 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:28.602896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0704f7b6-0be8-4a00-9785-0cc157ecb802 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:28.603333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0704f7b6-0be8-4a00-9785-0cc157ecb802 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:28.729886 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0704f7b6-0be8-4a00-9785-0cc157ecb802 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:28.737713 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0704f7b6-0be8-4a00-9785-0cc157ecb802 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1555 microversion: 2.1 time: 0.146250 May 16 15:16:28.738321 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 80/151] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:28 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:28.901036 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7cce2a98-1a59-485d-bbb8-73afa5b00e87 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:28.901638 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7cce2a98-1a59-485d-bbb8-73afa5b00e87 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:28.908662 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cce2a98-1a59-485d-bbb8-73afa5b00e87 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:28.909103 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cce2a98-1a59-485d-bbb8-73afa5b00e87 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:28.909861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cce2a98-1a59-485d-bbb8-73afa5b00e87 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:28.910343 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cce2a98-1a59-485d-bbb8-73afa5b00e87 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:29.041479 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7cce2a98-1a59-485d-bbb8-73afa5b00e87 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:29.049593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7cce2a98-1a59-485d-bbb8-73afa5b00e87 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.152254 May 16 15:16:29.057354 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 72/152] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:28 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:29.754914 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ac34bdb1-5f28-46b0-ad3f-929ec7e0f0ac tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:29.755461 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ac34bdb1-5f28-46b0-ad3f-929ec7e0f0ac tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:29.761164 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac34bdb1-5f28-46b0-ad3f-929ec7e0f0ac tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:29.761607 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac34bdb1-5f28-46b0-ad3f-929ec7e0f0ac tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:29.762380 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac34bdb1-5f28-46b0-ad3f-929ec7e0f0ac tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:29.762811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac34bdb1-5f28-46b0-ad3f-929ec7e0f0ac tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:29.888386 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ac34bdb1-5f28-46b0-ad3f-929ec7e0f0ac tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:29.896090 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ac34bdb1-5f28-46b0-ad3f-929ec7e0f0ac tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1555 microversion: 2.1 time: 0.145094 May 16 15:16:29.896659 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 81/153] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:29 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:30.066557 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7d858e23-c1e0-4b83-bd56-54df2019f80f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:30.067323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7d858e23-c1e0-4b83-bd56-54df2019f80f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:30.073908 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d858e23-c1e0-4b83-bd56-54df2019f80f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:30.074390 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d858e23-c1e0-4b83-bd56-54df2019f80f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:30.075156 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d858e23-c1e0-4b83-bd56-54df2019f80f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:30.075586 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d858e23-c1e0-4b83-bd56-54df2019f80f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:30.205318 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7d858e23-c1e0-4b83-bd56-54df2019f80f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:30.212566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7d858e23-c1e0-4b83-bd56-54df2019f80f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.149925 May 16 15:16:30.214458 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 73/154] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:30 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:30.912808 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e87162f8-12a0-4e7a-bdad-a59feab903dc tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:30.913412 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e87162f8-12a0-4e7a-bdad-a59feab903dc tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:30.919970 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e87162f8-12a0-4e7a-bdad-a59feab903dc tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:30.928663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e87162f8-12a0-4e7a-bdad-a59feab903dc tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:30.928663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e87162f8-12a0-4e7a-bdad-a59feab903dc tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:30.928663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e87162f8-12a0-4e7a-bdad-a59feab903dc tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:31.072820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e87162f8-12a0-4e7a-bdad-a59feab903dc tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:31.081345 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e87162f8-12a0-4e7a-bdad-a59feab903dc tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1555 microversion: 2.1 time: 0.172421 May 16 15:16:31.082355 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 82/155] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:30 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:31.229624 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-00a088fc-3732-468c-99d5-802de35cadad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:31.231383 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-00a088fc-3732-468c-99d5-802de35cadad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:31.237595 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00a088fc-3732-468c-99d5-802de35cadad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:31.238044 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00a088fc-3732-468c-99d5-802de35cadad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:31.238870 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00a088fc-3732-468c-99d5-802de35cadad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:31.239300 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00a088fc-3732-468c-99d5-802de35cadad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:31.451266 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-00a088fc-3732-468c-99d5-802de35cadad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:31.460309 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-00a088fc-3732-468c-99d5-802de35cadad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.234450 May 16 15:16:31.463776 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 74/156] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:31 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:31.511300 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1794181740", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "networks": [{"uuid": "6de467ee-ceef-4dff-8986-76afb32e2fd6"}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:31.520374 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-3386bac4-af7a-41b1-b1d9-5efb3bffc36d req-7a03123e-02f3-40da-bf3b-6988d599f80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb4f893-00bf-47fe-8ca4-74f9cfadd2b7", "name": "network-vif-deleted", "tag": "c4da502e-bee2-43da-bb06-65e396454359"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:31.536818 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-3386bac4-af7a-41b1-b1d9-5efb3bffc36d req-7a03123e-02f3-40da-bf3b-6988d599f80a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:31.537244 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-3386bac4-af7a-41b1-b1d9-5efb3bffc36d req-7a03123e-02f3-40da-bf3b-6988d599f80a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:31.548960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-3386bac4-af7a-41b1-b1d9-5efb3bffc36d req-7a03123e-02f3-40da-bf3b-6988d599f80a service nova] Creating event network-vif-deleted:c4da502e-bee2-43da-bb06-65e396454359 for instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 on hv-cinder-79578 May 16 15:16:31.554187 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-3386bac4-af7a-41b1-b1d9-5efb3bffc36d req-7a03123e-02f3-40da-bf3b-6988d599f80a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037453 May 16 15:16:31.557580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 75/157] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:31.577439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] validate_networks() for [('6de467ee-ceef-4dff-8986-76afb32e2fd6', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:16:31.975120 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:16:31.975699 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:16:31.976051 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:16:31.976382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:16:31.976788 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:16:31.986340 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:31.986741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:31.987595 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:31.988029 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:32.005219 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Getting quotas for project 7c186c3409f94fa5bb7452eee4021eea. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:16:32.009517 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Getting quotas for user 665ea1968aff4e949cdf07c210e78067 and project 7c186c3409f94fa5bb7452eee4021eea. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:16:32.023825 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:16:32.024526 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:16:32.099285 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-81e77766-ac70-4112-8144-3151d3a83b2f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:32.099968 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-81e77766-ac70-4112-8144-3151d3a83b2f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:32.106368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81e77766-ac70-4112-8144-3151d3a83b2f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:32.113262 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81e77766-ac70-4112-8144-3151d3a83b2f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:32.113262 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81e77766-ac70-4112-8144-3151d3a83b2f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:32.113262 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81e77766-ac70-4112-8144-3151d3a83b2f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:32.179482 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-81e77766-ac70-4112-8144-3151d3a83b2f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:32.189107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-81e77766-ac70-4112-8144-3151d3a83b2f tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1346 microversion: 2.1 time: 0.093565 May 16 15:16:32.191531 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-052462d4-709e-472c-a552-ee11b17a6556 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684899 May 16 15:16:32.192823 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 83/158] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:16:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 15:16:32.195026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 76/159] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:32 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:32.203331 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e58b90c5-e7cd-4793-9080-cc8b6d6389b9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:32.204191 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e58b90c5-e7cd-4793-9080-cc8b6d6389b9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:32.280120 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e58b90c5-e7cd-4793-9080-cc8b6d6389b9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:32.286638 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e58b90c5-e7cd-4793-9080-cc8b6d6389b9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1214 microversion: 2.1 time: 0.088048 May 16 15:16:32.287499 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 84/160] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:32 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:32.479880 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ec89805-9442-47dd-b582-44faad51a85a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:32.481007 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4ec89805-9442-47dd-b582-44faad51a85a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:32.487373 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ec89805-9442-47dd-b582-44faad51a85a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:32.488435 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ec89805-9442-47dd-b582-44faad51a85a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:32.489208 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ec89805-9442-47dd-b582-44faad51a85a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:32.489633 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ec89805-9442-47dd-b582-44faad51a85a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:32.619843 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4ec89805-9442-47dd-b582-44faad51a85a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:32.627837 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4ec89805-9442-47dd-b582-44faad51a85a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.151689 May 16 15:16:32.638743 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 77/161] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:32 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:33.206909 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ad880db8-a4f3-4f4d-901d-8f1eaef143e4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:33.207463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ad880db8-a4f3-4f4d-901d-8f1eaef143e4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:33.214372 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad880db8-a4f3-4f4d-901d-8f1eaef143e4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:33.215479 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad880db8-a4f3-4f4d-901d-8f1eaef143e4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:33.216264 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad880db8-a4f3-4f4d-901d-8f1eaef143e4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:33.216696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad880db8-a4f3-4f4d-901d-8f1eaef143e4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:33.280665 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ad880db8-a4f3-4f4d-901d-8f1eaef143e4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:33.289514 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ad880db8-a4f3-4f4d-901d-8f1eaef143e4 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1346 microversion: 2.1 time: 0.087461 May 16 15:16:33.295360 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 85/162] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:33 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:33.303312 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9f6e5048-1f4a-4efd-9df9-2753d214efdb tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:33.303916 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9f6e5048-1f4a-4efd-9df9-2753d214efdb tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:33.309799 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f6e5048-1f4a-4efd-9df9-2753d214efdb tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:33.310284 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f6e5048-1f4a-4efd-9df9-2753d214efdb tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:33.311039 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f6e5048-1f4a-4efd-9df9-2753d214efdb tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:33.311457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f6e5048-1f4a-4efd-9df9-2753d214efdb tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:33.376366 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9f6e5048-1f4a-4efd-9df9-2753d214efdb tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:33.383976 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9f6e5048-1f4a-4efd-9df9-2753d214efdb tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1218 microversion: 2.1 time: 0.084397 May 16 15:16:33.384619 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 78/163] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:33 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:33.651815 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f89f7f09-a383-4e5e-9524-c8408f1678e9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:33.652420 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f89f7f09-a383-4e5e-9524-c8408f1678e9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:33.658415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f89f7f09-a383-4e5e-9524-c8408f1678e9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:33.658870 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f89f7f09-a383-4e5e-9524-c8408f1678e9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:33.659640 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f89f7f09-a383-4e5e-9524-c8408f1678e9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:33.660078 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f89f7f09-a383-4e5e-9524-c8408f1678e9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:33.788677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f89f7f09-a383-4e5e-9524-c8408f1678e9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:33.796159 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f89f7f09-a383-4e5e-9524-c8408f1678e9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.148105 May 16 15:16:33.796757 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 86/164] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:33 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:34.306434 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b95f07b1-94c7-4f10-a26b-8f684746d730 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:34.307037 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b95f07b1-94c7-4f10-a26b-8f684746d730 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:34.313353 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b95f07b1-94c7-4f10-a26b-8f684746d730 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:34.313792 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b95f07b1-94c7-4f10-a26b-8f684746d730 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:34.314578 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b95f07b1-94c7-4f10-a26b-8f684746d730 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:34.315007 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b95f07b1-94c7-4f10-a26b-8f684746d730 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:34.376402 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b95f07b1-94c7-4f10-a26b-8f684746d730 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:34.384665 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b95f07b1-94c7-4f10-a26b-8f684746d730 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1346 microversion: 2.1 time: 0.082072 May 16 15:16:34.385382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 79/165] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:34 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:34.400451 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dbd02b12-9311-4870-84a5-67986eefed3b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:34.401058 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dbd02b12-9311-4870-84a5-67986eefed3b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:34.407483 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dbd02b12-9311-4870-84a5-67986eefed3b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:34.407926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dbd02b12-9311-4870-84a5-67986eefed3b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:34.408683 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dbd02b12-9311-4870-84a5-67986eefed3b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:34.409117 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dbd02b12-9311-4870-84a5-67986eefed3b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:34.617567 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-dbd02b12-9311-4870-84a5-67986eefed3b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:34.624980 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dbd02b12-9311-4870-84a5-67986eefed3b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1218 microversion: 2.1 time: 0.228309 May 16 15:16:34.625528 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 87/166] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:34 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1218 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:34.812621 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fc97388c-e6aa-4516-b871-9937a06e2814 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:34.813227 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fc97388c-e6aa-4516-b871-9937a06e2814 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:34.819060 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc97388c-e6aa-4516-b871-9937a06e2814 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:34.819761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc97388c-e6aa-4516-b871-9937a06e2814 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:34.820526 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc97388c-e6aa-4516-b871-9937a06e2814 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:34.820956 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc97388c-e6aa-4516-b871-9937a06e2814 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:34.961109 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fc97388c-e6aa-4516-b871-9937a06e2814 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:34.970280 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fc97388c-e6aa-4516-b871-9937a06e2814 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.161354 May 16 15:16:34.971278 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 80/167] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:34 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:35.404191 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4aacd2cf-e518-49f8-8d55-54f08aa09e1c tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:35.404191 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4aacd2cf-e518-49f8-8d55-54f08aa09e1c tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:35.407414 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4aacd2cf-e518-49f8-8d55-54f08aa09e1c tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:35.407873 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4aacd2cf-e518-49f8-8d55-54f08aa09e1c tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:35.408648 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4aacd2cf-e518-49f8-8d55-54f08aa09e1c tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:35.409242 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4aacd2cf-e518-49f8-8d55-54f08aa09e1c tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:35.471256 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4aacd2cf-e518-49f8-8d55-54f08aa09e1c tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:35.479483 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4aacd2cf-e518-49f8-8d55-54f08aa09e1c tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1346 microversion: 2.1 time: 0.082842 May 16 15:16:35.480675 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 88/168] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:35 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:35.641467 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d465e9c4-053d-45da-baca-7d28db8961d4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:35.642238 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d465e9c4-053d-45da-baca-7d28db8961d4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:35.652431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d465e9c4-053d-45da-baca-7d28db8961d4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:35.652431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d465e9c4-053d-45da-baca-7d28db8961d4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:35.652431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d465e9c4-053d-45da-baca-7d28db8961d4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:35.652431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d465e9c4-053d-45da-baca-7d28db8961d4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:35.721684 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d465e9c4-053d-45da-baca-7d28db8961d4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:35.728888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d465e9c4-053d-45da-baca-7d28db8961d4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1266 microversion: 2.1 time: 0.091331 May 16 15:16:35.729476 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 81/169] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:35 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:35.987083 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1026b49f-abdf-438a-8f3b-d4c620c59d48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:35.987643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1026b49f-abdf-438a-8f3b-d4c620c59d48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:35.994202 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1026b49f-abdf-438a-8f3b-d4c620c59d48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:35.994658 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1026b49f-abdf-438a-8f3b-d4c620c59d48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:35.995471 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1026b49f-abdf-438a-8f3b-d4c620c59d48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:35.995909 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1026b49f-abdf-438a-8f3b-d4c620c59d48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:36.151630 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1026b49f-abdf-438a-8f3b-d4c620c59d48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:36.163485 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1026b49f-abdf-438a-8f3b-d4c620c59d48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.180261 May 16 15:16:36.164432 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 89/170] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:35 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:36.497288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2965a1df-1bfc-4056-b3e8-432bf2a1da19 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:36.497898 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2965a1df-1bfc-4056-b3e8-432bf2a1da19 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:36.503904 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2965a1df-1bfc-4056-b3e8-432bf2a1da19 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:36.504350 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2965a1df-1bfc-4056-b3e8-432bf2a1da19 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:36.505114 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2965a1df-1bfc-4056-b3e8-432bf2a1da19 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:36.505549 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2965a1df-1bfc-4056-b3e8-432bf2a1da19 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:36.547384 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2965a1df-1bfc-4056-b3e8-432bf2a1da19 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:36.548082 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2965a1df-1bfc-4056-b3e8-432bf2a1da19 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:36.548543 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-2965a1df-1bfc-4056-b3e8-432bf2a1da19 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lazy-loading 'fault' on Instance uuid efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:16:36.629172 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2965a1df-1bfc-4056-b3e8-432bf2a1da19 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22de22e8d5964f29b577af216eb3cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb76045fec614358bd2bb89018436943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:36.647431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2965a1df-1bfc-4056-b3e8-432bf2a1da19 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 200 len: 1351 microversion: 2.1 time: 0.154466 May 16 15:16:36.657186 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 82/171] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:36 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 1351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:36.746722 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-60f0b95d-3aac-4de9-932e-e59d220bed98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:36.747440 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-60f0b95d-3aac-4de9-932e-e59d220bed98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:36.753681 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60f0b95d-3aac-4de9-932e-e59d220bed98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:36.754166 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60f0b95d-3aac-4de9-932e-e59d220bed98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:36.757033 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60f0b95d-3aac-4de9-932e-e59d220bed98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:36.757033 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60f0b95d-3aac-4de9-932e-e59d220bed98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:36.835589 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-60f0b95d-3aac-4de9-932e-e59d220bed98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:36.848724 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-60f0b95d-3aac-4de9-932e-e59d220bed98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1272 microversion: 2.1 time: 0.106124 May 16 15:16:36.858639 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 90/172] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:36 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:37.179978 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2da700b8-9c99-45d1-8548-47e781741e9b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:37.180565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2da700b8-9c99-45d1-8548-47e781741e9b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:37.187022 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2da700b8-9c99-45d1-8548-47e781741e9b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.187452 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2da700b8-9c99-45d1-8548-47e781741e9b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.188204 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2da700b8-9c99-45d1-8548-47e781741e9b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.188632 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2da700b8-9c99-45d1-8548-47e781741e9b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.538445 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2da700b8-9c99-45d1-8548-47e781741e9b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:37.546607 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2da700b8-9c99-45d1-8548-47e781741e9b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.370514 May 16 15:16:37.547169 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 83/173] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:37 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:37.668219 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-40e4affb-5b93-4a79-bdc4-35119642750d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:37.670008 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-40e4affb-5b93-4a79-bdc4-35119642750d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:37.681722 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40e4affb-5b93-4a79-bdc4-35119642750d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.682914 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40e4affb-5b93-4a79-bdc4-35119642750d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.685090 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40e4affb-5b93-4a79-bdc4-35119642750d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.685691 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40e4affb-5b93-4a79-bdc4-35119642750d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.712424 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-40e4affb-5b93-4a79-bdc4-35119642750d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] HTTP exception thrown: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-40e4affb-5b93-4a79-bdc4-35119642750d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Request method failure captured: May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 HTTP/1.1 May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqBTeKGE7yVgV2Qf28vE4z0prLQTpWKHk7iAoX4AccTn9xw-1kHxMAxs7X5Mu8xUn8kor_RhGUQXNBxiUvLscaKtUQqp4129HvtUlfQczG-j9vMzX8fW7bVjJiAJi9hdO2aQGdadjuAfSTJBHNiuSl6aHMSKCXZbF6i3DoYG4speWw May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: bb76045fec614358bd2bb89018436943 May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-DeleteServersTestJSON-830922431 May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:16:37.723804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bb76045fec614358bd2bb89018436943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bb76045fec614358bd2bb89018436943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bb76045fec614358bd2bb89018436943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bb76045fec614358bd2bb89018436943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-DeleteServersTestJSON-830922431 May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: bb76045fec614358bd2bb89018436943 May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-DeleteServersTestJSON-830922431 May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-DeleteServersTestJSON-830922431-project May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 22de22e8d5964f29b577af216eb3cdd9 May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-DeleteServersTestJSON-830922431-project May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:37.726293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': 'efb4f893-00bf-47fe-8ca4-74f9cfadd2b7'} May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:16:37.727910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:37.730457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:16:37.734949 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-40e4affb-5b93-4a79-bdc4-35119642750d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Returning 404 to user: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:16:37.736604 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-40e4affb-5b93-4a79-bdc4-35119642750d tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 404 len: 111 microversion: 2.1 time: 0.074776 May 16 15:16:37.743248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 91/174] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:37 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:16:37.864784 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-10de9eed-c0c7-4a0b-9905-6a807ab52328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:37.866248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d94be2ac-b361-4e61-b7cd-65e99ffdf116 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:37.866744 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-10de9eed-c0c7-4a0b-9905-6a807ab52328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:37.867580 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d94be2ac-b361-4e61-b7cd-65e99ffdf116 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:37.877567 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d94be2ac-b361-4e61-b7cd-65e99ffdf116 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.878695 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d94be2ac-b361-4e61-b7cd-65e99ffdf116 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.879915 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d94be2ac-b361-4e61-b7cd-65e99ffdf116 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.880468 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d94be2ac-b361-4e61-b7cd-65e99ffdf116 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.883432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10de9eed-c0c7-4a0b-9905-6a807ab52328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.884186 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10de9eed-c0c7-4a0b-9905-6a807ab52328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.885316 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10de9eed-c0c7-4a0b-9905-6a807ab52328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:37.887122 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10de9eed-c0c7-4a0b-9905-6a807ab52328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:37.904035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-10de9eed-c0c7-4a0b-9905-6a807ab52328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] HTTP exception thrown: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-10de9eed-c0c7-4a0b-9905-6a807ab52328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Request method failure captured: May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7/os-volume_attachments HTTP/1.1 May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqBTeKGE7yVgV2Qf28vE4z0prLQTpWKHk7iAoX4AccTn9xw-1kHxMAxs7X5Mu8xUn8kor_RhGUQXNBxiUvLscaKtUQqp4129HvtUlfQczG-j9vMzX8fW7bVjJiAJi9hdO2aQGdadjuAfSTJBHNiuSl6aHMSKCXZbF6i3DoYG4speWw May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: bb76045fec614358bd2bb89018436943 May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-DeleteServersTestJSON-830922431 May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:16:37.910194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bb76045fec614358bd2bb89018436943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bb76045fec614358bd2bb89018436943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bb76045fec614358bd2bb89018436943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bb76045fec614358bd2bb89018436943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-DeleteServersTestJSON-830922431 May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: bb76045fec614358bd2bb89018436943 May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-DeleteServersTestJSON-830922431 May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-DeleteServersTestJSON-830922431-project May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 22de22e8d5964f29b577af216eb3cdd9 May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-DeleteServersTestJSON-830922431-project May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:37.911522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'server_id': 'efb4f893-00bf-47fe-8ca4-74f9cfadd2b7'} May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:16:37.912513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:37.913676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:16:37.915055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-10de9eed-c0c7-4a0b-9905-6a807ab52328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Returning 404 to user: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:16:37.915055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-10de9eed-c0c7-4a0b-9905-6a807ab52328 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051409 May 16 15:16:37.915055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 84/175] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:16:37 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:16:38.042549 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d94be2ac-b361-4e61-b7cd-65e99ffdf116 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:38.050561 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d94be2ac-b361-4e61-b7cd-65e99ffdf116 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1314 microversion: 2.1 time: 0.188239 May 16 15:16:38.051389 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 92/176] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:37 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:38.564655 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-15509288-1231-42d0-b40e-668e62034698 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:38.565420 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-15509288-1231-42d0-b40e-668e62034698 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:38.587366 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15509288-1231-42d0-b40e-668e62034698 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:38.587366 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15509288-1231-42d0-b40e-668e62034698 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:38.587366 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15509288-1231-42d0-b40e-668e62034698 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:38.587366 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15509288-1231-42d0-b40e-668e62034698 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:38.641995 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-9c11b258-c737-4647-ac47-a595eb4579f6 req-8931d573-f34f-4873-9371-2b39b750c053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a892b3-2c69-47f7-b9ae-503f73dde5ef", "tag": "951fad15-ebba-4219-8b81-211bf8007b8d"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:38.651111 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-9c11b258-c737-4647-ac47-a595eb4579f6 req-8931d573-f34f-4873-9371-2b39b750c053 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:38.651847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-9c11b258-c737-4647-ac47-a595eb4579f6 req-8931d573-f34f-4873-9371-2b39b750c053 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:38.665082 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-9c11b258-c737-4647-ac47-a595eb4579f6 req-8931d573-f34f-4873-9371-2b39b750c053 service nova] Creating event network-changed:951fad15-ebba-4219-8b81-211bf8007b8d for instance 01a892b3-2c69-47f7-b9ae-503f73dde5ef on hv-cinder-79578 May 16 15:16:38.672996 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-9c11b258-c737-4647-ac47-a595eb4579f6 req-8931d573-f34f-4873-9371-2b39b750c053 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036301 May 16 15:16:38.678139 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 93/177] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:16:38.764269 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-15509288-1231-42d0-b40e-668e62034698 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:38.772132 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-15509288-1231-42d0-b40e-668e62034698 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.211920 May 16 15:16:38.778546 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 85/178] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:38 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:39.068150 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f7b82508-a140-4b5b-8033-a89f1a92e39d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:39.068847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f7b82508-a140-4b5b-8033-a89f1a92e39d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:39.075547 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7b82508-a140-4b5b-8033-a89f1a92e39d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:39.076016 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7b82508-a140-4b5b-8033-a89f1a92e39d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:39.076837 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7b82508-a140-4b5b-8033-a89f1a92e39d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:39.077439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7b82508-a140-4b5b-8033-a89f1a92e39d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:39.215487 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f7b82508-a140-4b5b-8033-a89f1a92e39d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:39.223766 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f7b82508-a140-4b5b-8033-a89f1a92e39d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1314 microversion: 2.1 time: 0.160240 May 16 15:16:39.224538 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 94/179] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:39 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:39.612466 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3a4a2a80-b3eb-466e-9d44-16eade1e7b01 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:39.612959 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3a4a2a80-b3eb-466e-9d44-16eade1e7b01 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:39.619790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a4a2a80-b3eb-466e-9d44-16eade1e7b01 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:39.620325 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a4a2a80-b3eb-466e-9d44-16eade1e7b01 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:39.621102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a4a2a80-b3eb-466e-9d44-16eade1e7b01 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:39.621718 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a4a2a80-b3eb-466e-9d44-16eade1e7b01 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:39.635441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-3a4a2a80-b3eb-466e-9d44-16eade1e7b01 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] HTTP exception thrown: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3a4a2a80-b3eb-466e-9d44-16eade1e7b01 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Request method failure captured: May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 HTTP/1.1 May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqBTeKGE7yVgV2Qf28vE4z0prLQTpWKHk7iAoX4AccTn9xw-1kHxMAxs7X5Mu8xUn8kor_RhGUQXNBxiUvLscaKtUQqp4129HvtUlfQczG-j9vMzX8fW7bVjJiAJi9hdO2aQGdadjuAfSTJBHNiuSl6aHMSKCXZbF6i3DoYG4speWw May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: bb76045fec614358bd2bb89018436943 May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-DeleteServersTestJSON-830922431 May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:16:39.637875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bb76045fec614358bd2bb89018436943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bb76045fec614358bd2bb89018436943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bb76045fec614358bd2bb89018436943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bb76045fec614358bd2bb89018436943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-DeleteServersTestJSON-830922431 May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: bb76045fec614358bd2bb89018436943 May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-DeleteServersTestJSON-830922431 May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-DeleteServersTestJSON-830922431-project May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 22de22e8d5964f29b577af216eb3cdd9 May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-DeleteServersTestJSON-830922431-project May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:39.639536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'efb4f893-00bf-47fe-8ca4-74f9cfadd2b7'} May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:16:39.640308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:39.641720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:16:39.643078 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3a4a2a80-b3eb-466e-9d44-16eade1e7b01 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Returning 404 to user: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:16:39.643078 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3a4a2a80-b3eb-466e-9d44-16eade1e7b01 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "DELETE /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 404 len: 111 microversion: 2.1 time: 0.031683 May 16 15:16:39.643078 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 86/180] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:16:39 2022] DELETE /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:16:39.648362 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8272e39a-6242-49bc-841d-c1345662b684 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:39.649094 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8272e39a-6242-49bc-841d-c1345662b684 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] [instance: efb4f893-00bf-47fe-8ca4-74f9cfadd2b7] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:39.656449 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8272e39a-6242-49bc-841d-c1345662b684 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:39.656907 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8272e39a-6242-49bc-841d-c1345662b684 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:39.657761 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8272e39a-6242-49bc-841d-c1345662b684 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:39.658295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8272e39a-6242-49bc-841d-c1345662b684 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:39.672613 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-8272e39a-6242-49bc-841d-c1345662b684 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] HTTP exception thrown: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8272e39a-6242-49bc-841d-c1345662b684 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Request method failure captured: May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 HTTP/1.1 May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqBTeKGE7yVgV2Qf28vE4z0prLQTpWKHk7iAoX4AccTn9xw-1kHxMAxs7X5Mu8xUn8kor_RhGUQXNBxiUvLscaKtUQqp4129HvtUlfQczG-j9vMzX8fW7bVjJiAJi9hdO2aQGdadjuAfSTJBHNiuSl6aHMSKCXZbF6i3DoYG4speWw May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: bb76045fec614358bd2bb89018436943 May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-DeleteServersTestJSON-830922431 May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:16:39.674273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bb76045fec614358bd2bb89018436943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bb76045fec614358bd2bb89018436943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bb76045fec614358bd2bb89018436943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bb76045fec614358bd2bb89018436943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-DeleteServersTestJSON-830922431 May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: bb76045fec614358bd2bb89018436943 May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-DeleteServersTestJSON-830922431 May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-DeleteServersTestJSON-830922431-project May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 22de22e8d5964f29b577af216eb3cdd9 May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-DeleteServersTestJSON-830922431-project May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:39.675706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': 'efb4f893-00bf-47fe-8ca4-74f9cfadd2b7'} May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:16:39.676603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. May 16 15:16:39.677950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:16:39.679196 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8272e39a-6242-49bc-841d-c1345662b684 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] Returning 404 to user: Instance efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:16:39.679196 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8272e39a-6242-49bc-841d-c1345662b684 tempest-DeleteServersTestJSON-830922431 tempest-DeleteServersTestJSON-830922431-project] 10.222.0.44 "GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7" status: 404 len: 111 microversion: 2.1 time: 0.031273 May 16 15:16:39.679196 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 95/181] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:39 2022] GET /compute/v2.1/servers/efb4f893-00bf-47fe-8ca4-74f9cfadd2b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:16:39.788959 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cca90410-f16c-43b1-9c90-bc730761ab95 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:39.789711 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cca90410-f16c-43b1-9c90-bc730761ab95 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:39.796494 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cca90410-f16c-43b1-9c90-bc730761ab95 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:39.797021 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cca90410-f16c-43b1-9c90-bc730761ab95 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:39.798003 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cca90410-f16c-43b1-9c90-bc730761ab95 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:39.798537 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cca90410-f16c-43b1-9c90-bc730761ab95 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:39.955753 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cca90410-f16c-43b1-9c90-bc730761ab95 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:39.963234 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cca90410-f16c-43b1-9c90-bc730761ab95 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.178495 May 16 15:16:39.964432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 87/182] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:39 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:40.240707 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f69a6fad-1c2d-4241-86d6-c19ff2c187c7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:40.241501 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f69a6fad-1c2d-4241-86d6-c19ff2c187c7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:40.248214 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f69a6fad-1c2d-4241-86d6-c19ff2c187c7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:40.248669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f69a6fad-1c2d-4241-86d6-c19ff2c187c7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:40.249441 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f69a6fad-1c2d-4241-86d6-c19ff2c187c7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:40.249886 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f69a6fad-1c2d-4241-86d6-c19ff2c187c7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:40.409664 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f69a6fad-1c2d-4241-86d6-c19ff2c187c7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:40.417114 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f69a6fad-1c2d-4241-86d6-c19ff2c187c7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1314 microversion: 2.1 time: 0.180298 May 16 15:16:40.418244 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 96/183] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:40 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:40.985362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d3bd34c2-91be-44a9-88b7-9196ab0ffa45 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:41.000480 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d3bd34c2-91be-44a9-88b7-9196ab0ffa45 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:41.007355 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d3bd34c2-91be-44a9-88b7-9196ab0ffa45 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:41.008095 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d3bd34c2-91be-44a9-88b7-9196ab0ffa45 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:41.009105 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d3bd34c2-91be-44a9-88b7-9196ab0ffa45 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:41.010850 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d3bd34c2-91be-44a9-88b7-9196ab0ffa45 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:41.205455 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d3bd34c2-91be-44a9-88b7-9196ab0ffa45 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:41.214413 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d3bd34c2-91be-44a9-88b7-9196ab0ffa45 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.237020 May 16 15:16:41.214988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 88/184] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:40 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:41.438342 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ee8b4d18-f3b4-45f0-9e07-c4b4e351be4a tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:41.445703 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ee8b4d18-f3b4-45f0-9e07-c4b4e351be4a tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:41.453095 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ee8b4d18-f3b4-45f0-9e07-c4b4e351be4a tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:41.453600 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ee8b4d18-f3b4-45f0-9e07-c4b4e351be4a tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:41.454415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ee8b4d18-f3b4-45f0-9e07-c4b4e351be4a tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:41.455146 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ee8b4d18-f3b4-45f0-9e07-c4b4e351be4a tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:41.834274 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ee8b4d18-f3b4-45f0-9e07-c4b4e351be4a tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:41.842114 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ee8b4d18-f3b4-45f0-9e07-c4b4e351be4a tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1314 microversion: 2.1 time: 0.409933 May 16 15:16:41.842690 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 97/185] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:41 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:42.232057 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6391745a-3e0b-4808-b39d-b437b8308034 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:42.232659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6391745a-3e0b-4808-b39d-b437b8308034 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:42.243329 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6391745a-3e0b-4808-b39d-b437b8308034 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:42.243329 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6391745a-3e0b-4808-b39d-b437b8308034 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:42.243329 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6391745a-3e0b-4808-b39d-b437b8308034 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:42.243329 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6391745a-3e0b-4808-b39d-b437b8308034 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:42.381063 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6391745a-3e0b-4808-b39d-b437b8308034 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:42.389208 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6391745a-3e0b-4808-b39d-b437b8308034 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.161484 May 16 15:16:42.390194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 89/186] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:42 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:42.864821 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-741a7c5c-cb52-4eef-b264-5041c8aa6b5b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:42.866037 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-741a7c5c-cb52-4eef-b264-5041c8aa6b5b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:42.873087 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-741a7c5c-cb52-4eef-b264-5041c8aa6b5b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:42.873529 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-741a7c5c-cb52-4eef-b264-5041c8aa6b5b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:42.874489 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-741a7c5c-cb52-4eef-b264-5041c8aa6b5b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:42.874954 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-741a7c5c-cb52-4eef-b264-5041c8aa6b5b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:43.044452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-741a7c5c-cb52-4eef-b264-5041c8aa6b5b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:43.052380 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-741a7c5c-cb52-4eef-b264-5041c8aa6b5b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1314 microversion: 2.1 time: 0.192731 May 16 15:16:43.053247 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 98/187] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:42 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:43.407971 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6b5bccad-fff4-4052-8a92-326a2a16f1d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:43.409028 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6b5bccad-fff4-4052-8a92-326a2a16f1d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:43.417467 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b5bccad-fff4-4052-8a92-326a2a16f1d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:43.417913 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b5bccad-fff4-4052-8a92-326a2a16f1d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:43.418760 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b5bccad-fff4-4052-8a92-326a2a16f1d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:43.419187 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b5bccad-fff4-4052-8a92-326a2a16f1d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:43.596078 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6b5bccad-fff4-4052-8a92-326a2a16f1d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:43.608232 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6b5bccad-fff4-4052-8a92-326a2a16f1d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.204523 May 16 15:16:43.608793 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 90/188] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:43 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:44.022913 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-83834743-b355-46ae-af0a-28da119afa45 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] Calling method '.version_select at 0x7fc9ac12bca0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:44.075407 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-81e79272-461b-459e-9f6f-7c93e345f432 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:44.076494 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-81e79272-461b-459e-9f6f-7c93e345f432 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:44.087032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81e79272-461b-459e-9f6f-7c93e345f432 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:44.087908 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81e79272-461b-459e-9f6f-7c93e345f432 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:44.088815 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81e79272-461b-459e-9f6f-7c93e345f432 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:44.089378 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81e79272-461b-459e-9f6f-7c93e345f432 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:44.105137 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-83834743-b355-46ae-af0a-28da119afa45 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/10f9064e-310b-4ecd-aa3d-2adb5829bf39" status: 200 len: 351 microversion: 2.1 time: 0.086947 May 16 15:16:44.106433 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 99/189] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:16:44 2022] GET /compute/v2.1/os-volumes/10f9064e-310b-4ecd-aa3d-2adb5829bf39 => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:44.319723 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-81e79272-461b-459e-9f6f-7c93e345f432 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:44.330745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-81e79272-461b-459e-9f6f-7c93e345f432 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1314 microversion: 2.1 time: 0.262376 May 16 15:16:44.331342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 91/190] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:44 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:44.625368 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fb0ee876-1f27-45ab-9f6d-098162a0cf21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:44.625877 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fb0ee876-1f27-45ab-9f6d-098162a0cf21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:44.632972 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb0ee876-1f27-45ab-9f6d-098162a0cf21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:44.637544 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb0ee876-1f27-45ab-9f6d-098162a0cf21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:44.637544 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb0ee876-1f27-45ab-9f6d-098162a0cf21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:44.637544 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb0ee876-1f27-45ab-9f6d-098162a0cf21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:44.799519 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fb0ee876-1f27-45ab-9f6d-098162a0cf21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:44.808180 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fb0ee876-1f27-45ab-9f6d-098162a0cf21 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.186059 May 16 15:16:44.809169 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 100/191] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:44 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:45.347528 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-50f0a3cc-0e23-429c-baca-736df4f64731 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:45.348342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-50f0a3cc-0e23-429c-baca-736df4f64731 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:45.354954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50f0a3cc-0e23-429c-baca-736df4f64731 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:45.355485 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50f0a3cc-0e23-429c-baca-736df4f64731 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:45.356465 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50f0a3cc-0e23-429c-baca-736df4f64731 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:45.356959 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50f0a3cc-0e23-429c-baca-736df4f64731 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:45.493297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-50f0a3cc-0e23-429c-baca-736df4f64731 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:45.501125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-50f0a3cc-0e23-429c-baca-736df4f64731 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1314 microversion: 2.1 time: 0.157406 May 16 15:16:45.501682 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 92/192] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:45 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:45.825821 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f1ed685f-6fb3-4e56-b254-d1ba44541aea tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:45.826454 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f1ed685f-6fb3-4e56-b254-d1ba44541aea tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:45.832451 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1ed685f-6fb3-4e56-b254-d1ba44541aea tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:45.832902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1ed685f-6fb3-4e56-b254-d1ba44541aea tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:45.833665 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1ed685f-6fb3-4e56-b254-d1ba44541aea tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:45.834128 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1ed685f-6fb3-4e56-b254-d1ba44541aea tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:45.920464 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a66a8415-c769-4e63-b24f-aff13acacbd4 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] Calling method '.version_select at 0x7fc9a7efb9d0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:46.008951 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a66a8415-c769-4e63-b24f-aff13acacbd4 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/0459c7bd-4f14-43b4-897e-ad7f7c2e079b" status: 200 len: 351 microversion: 2.1 time: 0.092644 May 16 15:16:46.009549 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 93/193] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:16:45 2022] GET /compute/v2.1/os-volumes/0459c7bd-4f14-43b4-897e-ad7f7c2e079b => generated 351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:16:46.068248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f1ed685f-6fb3-4e56-b254-d1ba44541aea tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:46.085536 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f1ed685f-6fb3-4e56-b254-d1ba44541aea tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.264094 May 16 15:16:46.086421 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 101/194] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:45 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:46.205471 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-4ef10027-a424-492d-91dc-4c791eabc296 req-e63f9af1-30bd-453c-b905-d9377453bb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a892b3-2c69-47f7-b9ae-503f73dde5ef", "name": "network-vif-plugged", "status": "completed", "tag": "951fad15-ebba-4219-8b81-211bf8007b8d"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:46.213849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-4ef10027-a424-492d-91dc-4c791eabc296 req-e63f9af1-30bd-453c-b905-d9377453bb5b service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:46.214918 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-4ef10027-a424-492d-91dc-4c791eabc296 req-e63f9af1-30bd-453c-b905-d9377453bb5b service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:46.227435 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-4ef10027-a424-492d-91dc-4c791eabc296 req-e63f9af1-30bd-453c-b905-d9377453bb5b service nova] Creating event network-vif-plugged:951fad15-ebba-4219-8b81-211bf8007b8d for instance 01a892b3-2c69-47f7-b9ae-503f73dde5ef on hv-cinder-79578 May 16 15:16:46.233115 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-4ef10027-a424-492d-91dc-4c791eabc296 req-e63f9af1-30bd-453c-b905-d9377453bb5b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031799 May 16 15:16:46.233890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 94/195] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:46.518672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-429dfd6f-4278-4610-ab2e-83ff3b339d49 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:46.520091 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-429dfd6f-4278-4610-ab2e-83ff3b339d49 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:46.526895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-429dfd6f-4278-4610-ab2e-83ff3b339d49 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:46.527355 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-429dfd6f-4278-4610-ab2e-83ff3b339d49 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:46.528130 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-429dfd6f-4278-4610-ab2e-83ff3b339d49 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:46.528564 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-429dfd6f-4278-4610-ab2e-83ff3b339d49 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:46.672739 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-429dfd6f-4278-4610-ab2e-83ff3b339d49 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:46.679959 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-429dfd6f-4278-4610-ab2e-83ff3b339d49 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1314 microversion: 2.1 time: 0.165110 May 16 15:16:46.680519 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 102/196] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:46 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:47.103286 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2fefa521-fef5-4f46-b270-a45b6a68cff8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:47.104044 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2fefa521-fef5-4f46-b270-a45b6a68cff8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:47.110786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fefa521-fef5-4f46-b270-a45b6a68cff8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:47.111233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fefa521-fef5-4f46-b270-a45b6a68cff8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:47.112017 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fefa521-fef5-4f46-b270-a45b6a68cff8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:47.112452 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fefa521-fef5-4f46-b270-a45b6a68cff8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:47.262310 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2fefa521-fef5-4f46-b270-a45b6a68cff8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:47.270291 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2fefa521-fef5-4f46-b270-a45b6a68cff8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.171354 May 16 15:16:47.270862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 95/197] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:47 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:47.697837 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-80318afd-e7da-4dd3-8e9c-c0cfbe89b421 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:47.698472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-80318afd-e7da-4dd3-8e9c-c0cfbe89b421 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:47.706180 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6c8c50da-915a-499f-bf87-8bb69d1ab3b3 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] Calling method '.version_select at 0x7fc9a7ea3700>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:47.717984 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80318afd-e7da-4dd3-8e9c-c0cfbe89b421 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:47.718454 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80318afd-e7da-4dd3-8e9c-c0cfbe89b421 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:47.719402 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80318afd-e7da-4dd3-8e9c-c0cfbe89b421 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:47.719981 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80318afd-e7da-4dd3-8e9c-c0cfbe89b421 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:47.765875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6c8c50da-915a-499f-bf87-8bb69d1ab3b3 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/ff2d6a0d-6842-47b0-82e7-494f589050ba" status: 200 len: 350 microversion: 2.1 time: 0.063278 May 16 15:16:47.766727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 96/198] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:16:47 2022] GET /compute/v2.1/os-volumes/ff2d6a0d-6842-47b0-82e7-494f589050ba => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:16:47.780871 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4fa960a2-29f1-4e26-a647-4e14b99a8bd0 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] Calling method '.version_select at 0x7fc9a7f973a0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:47.854427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-80318afd-e7da-4dd3-8e9c-c0cfbe89b421 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:47.862286 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-80318afd-e7da-4dd3-8e9c-c0cfbe89b421 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1314 microversion: 2.1 time: 0.168620 May 16 15:16:47.862853 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 103/199] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:47 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:47.960445 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4fa960a2-29f1-4e26-a647-4e14b99a8bd0 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.184953 May 16 15:16:47.961160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 97/200] 10.222.0.44 () {58 vars in 1133 bytes} [Mon May 16 15:16:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:47.973277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7d206b60-06bb-40b6-86ad-82c8accff2b8 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] Calling method '.version_select at 0x7fc9a6edc9d0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:48.073339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7d206b60-06bb-40b6-86ad-82c8accff2b8 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.103832 May 16 15:16:48.073902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 104/201] 10.222.0.44 () {58 vars in 1148 bytes} [Mon May 16 15:16:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:48.086965 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1ea1e7b5-9a25-4c75-bd9f-37d7b054e369 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] Calling method '.version_select at 0x7fc9a7efb4c0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:48.170756 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1ea1e7b5-9a25-4c75-bd9f-37d7b054e369 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087452 May 16 15:16:48.172115 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 98/202] 10.222.0.44 () {58 vars in 1133 bytes} [Mon May 16 15:16:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:48.183941 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4956810c-b0d1-483f-9544-ac7a0ad19451 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] Calling method '.version_select at 0x7fc9a6eca700>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:48.287613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5cc5313e-8c62-4e98-b73e-aad46671a10c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:48.288366 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5cc5313e-8c62-4e98-b73e-aad46671a10c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:48.296152 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cc5313e-8c62-4e98-b73e-aad46671a10c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:48.296996 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cc5313e-8c62-4e98-b73e-aad46671a10c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:48.297905 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cc5313e-8c62-4e98-b73e-aad46671a10c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:48.298522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cc5313e-8c62-4e98-b73e-aad46671a10c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:48.336866 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4956810c-b0d1-483f-9544-ac7a0ad19451 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.156765 May 16 15:16:48.337539 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 105/203] 10.222.0.44 () {58 vars in 1166 bytes} [Mon May 16 15:16:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:48.349968 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ceaa0d66-8f0e-4cc3-b67e-10f134e26303 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] Calling method '.version_select at 0x7fc9a6ed4670>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:48.451364 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ceaa0d66-8f0e-4cc3-b67e-10f134e26303 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.096630 May 16 15:16:48.451364 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 106/204] 10.222.0.44 () {58 vars in 1169 bytes} [Mon May 16 15:16:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:48.455720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5cc5313e-8c62-4e98-b73e-aad46671a10c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:48.457038 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-74281b54-1aaa-41fd-92a0-202b77019060 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] Calling method '.version_select at 0x7fc9a6ed4af0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:48.464344 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5cc5313e-8c62-4e98-b73e-aad46671a10c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1523 microversion: 2.1 time: 0.180339 May 16 15:16:48.465611 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 99/205] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:48 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:48.596156 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-74281b54-1aaa-41fd-92a0-202b77019060 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.143443 May 16 15:16:48.603170 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 107/206] 10.222.0.44 () {58 vars in 1154 bytes} [Mon May 16 15:16:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:48.609961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2843ab67-1812-49f6-b282-eac831088b4e tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] Calling method '.version_select at 0x7fc9a7ea1310>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:48.765646 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2843ab67-1812-49f6-b282-eac831088b4e tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.158245 May 16 15:16:48.765646 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 100/207] 10.222.0.44 () {58 vars in 1187 bytes} [Mon May 16 15:16:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:16:48.776450 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7261acde-b0f8-4126-9748-06455ee56b64 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] Calling method '.version_select at 0x7fc9ac103e50>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:48.879805 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e90c3710-1c77-4a59-a316-846a7d3df3db tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:48.880539 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e90c3710-1c77-4a59-a316-846a7d3df3db tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:48.883565 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7261acde-b0f8-4126-9748-06455ee56b64 tempest-VolumesTestJSON-2083926323 tempest-VolumesTestJSON-2083926323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.110917 May 16 15:16:48.884230 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 108/208] 10.222.0.44 () {58 vars in 1154 bytes} [Mon May 16 15:16:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:48.886714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e90c3710-1c77-4a59-a316-846a7d3df3db tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:48.887732 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e90c3710-1c77-4a59-a316-846a7d3df3db tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:48.888506 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e90c3710-1c77-4a59-a316-846a7d3df3db tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:48.888942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e90c3710-1c77-4a59-a316-846a7d3df3db tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:49.037850 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e90c3710-1c77-4a59-a316-846a7d3df3db tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:49.045825 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e90c3710-1c77-4a59-a316-846a7d3df3db tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1314 microversion: 2.1 time: 0.169850 May 16 15:16:49.050603 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 101/209] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:48 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:49.482087 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d0cd0817-2a34-42b9-a9eb-eddbfa8c5d8b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:49.482672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d0cd0817-2a34-42b9-a9eb-eddbfa8c5d8b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:49.489119 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0cd0817-2a34-42b9-a9eb-eddbfa8c5d8b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:49.489561 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0cd0817-2a34-42b9-a9eb-eddbfa8c5d8b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:49.490341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0cd0817-2a34-42b9-a9eb-eddbfa8c5d8b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:49.490770 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0cd0817-2a34-42b9-a9eb-eddbfa8c5d8b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:49.624561 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d0cd0817-2a34-42b9-a9eb-eddbfa8c5d8b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:49.631913 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d0cd0817-2a34-42b9-a9eb-eddbfa8c5d8b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1503 microversion: 2.1 time: 0.154161 May 16 15:16:49.636538 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 109/210] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:49 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:49.647417 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fc856a11-7fce-4706-a187-e8a48f3903a7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:49.648030 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fc856a11-7fce-4706-a187-e8a48f3903a7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:49.654977 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc856a11-7fce-4706-a187-e8a48f3903a7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:49.655424 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc856a11-7fce-4706-a187-e8a48f3903a7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:49.656186 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc856a11-7fce-4706-a187-e8a48f3903a7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:49.656623 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc856a11-7fce-4706-a187-e8a48f3903a7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:49.782660 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fc856a11-7fce-4706-a187-e8a48f3903a7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:49.789895 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fc856a11-7fce-4706-a187-e8a48f3903a7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1516 microversion: 2.1 time: 0.146311 May 16 15:16:49.790493 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 102/211] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:49 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1516 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:50.063708 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-54df22b3-8db8-4d6d-9caa-a713116ef064 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:50.064845 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-54df22b3-8db8-4d6d-9caa-a713116ef064 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:50.071150 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54df22b3-8db8-4d6d-9caa-a713116ef064 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:50.071598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54df22b3-8db8-4d6d-9caa-a713116ef064 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:50.072385 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54df22b3-8db8-4d6d-9caa-a713116ef064 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:50.072819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54df22b3-8db8-4d6d-9caa-a713116ef064 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:50.207550 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-54df22b3-8db8-4d6d-9caa-a713116ef064 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:50.215346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-54df22b3-8db8-4d6d-9caa-a713116ef064 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1314 microversion: 2.1 time: 0.155383 May 16 15:16:50.218408 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 110/212] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:50 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:51.233961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f19290f9-c8f2-44ea-b03c-29432822f62b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:51.235605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f19290f9-c8f2-44ea-b03c-29432822f62b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:51.242256 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f19290f9-c8f2-44ea-b03c-29432822f62b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:51.242920 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f19290f9-c8f2-44ea-b03c-29432822f62b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:51.243694 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f19290f9-c8f2-44ea-b03c-29432822f62b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:51.244277 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f19290f9-c8f2-44ea-b03c-29432822f62b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:51.383144 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f19290f9-c8f2-44ea-b03c-29432822f62b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:51.391008 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f19290f9-c8f2-44ea-b03c-29432822f62b tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1497 microversion: 2.1 time: 0.161837 May 16 15:16:51.391943 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 103/213] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:51 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:51.771022 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c99f314c-6f9f-4f79-8ca7-42b3c8dd79da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:51.772181 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c99f314c-6f9f-4f79-8ca7-42b3c8dd79da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:51.778530 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c99f314c-6f9f-4f79-8ca7-42b3c8dd79da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:51.779038 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c99f314c-6f9f-4f79-8ca7-42b3c8dd79da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:51.779880 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c99f314c-6f9f-4f79-8ca7-42b3c8dd79da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:51.780305 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c99f314c-6f9f-4f79-8ca7-42b3c8dd79da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:51.805740 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-c99f314c-6f9f-4f79-8ca7-42b3c8dd79da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lazy-loading 'flavor' on Instance uuid b8cc0b00-99f9-4486-b349-f60a0d2db023 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:16:52.089100 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c99f314c-6f9f-4f79-8ca7-42b3c8dd79da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "POST /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023/action" status: 200 len: 32 microversion: 2.1 time: 0.322013 May 16 15:16:52.091305 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 111/214] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:16:51 2022] POST /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023/action => generated 32 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:16:52.099275 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-706cd589-7e4e-41f6-86bb-38d486bad026 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:52.099935 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-706cd589-7e4e-41f6-86bb-38d486bad026 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:52.106472 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-706cd589-7e4e-41f6-86bb-38d486bad026 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:52.106921 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-706cd589-7e4e-41f6-86bb-38d486bad026 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:52.107702 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-706cd589-7e4e-41f6-86bb-38d486bad026 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:52.108138 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-706cd589-7e4e-41f6-86bb-38d486bad026 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:52.246431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-706cd589-7e4e-41f6-86bb-38d486bad026 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:52.253854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-706cd589-7e4e-41f6-86bb-38d486bad026 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.158368 May 16 15:16:52.254449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 104/215] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:52 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:53.271158 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a837cd30-52f0-479e-9f81-76e307df623b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:53.271963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a837cd30-52f0-479e-9f81-76e307df623b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:53.277945 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a837cd30-52f0-479e-9f81-76e307df623b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:53.278426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a837cd30-52f0-479e-9f81-76e307df623b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:53.279195 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a837cd30-52f0-479e-9f81-76e307df623b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:53.279631 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a837cd30-52f0-479e-9f81-76e307df623b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:53.413355 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a837cd30-52f0-479e-9f81-76e307df623b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:53.422003 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a837cd30-52f0-479e-9f81-76e307df623b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.155026 May 16 15:16:53.422612 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 112/216] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:53 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:54.439623 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-26d55b72-8423-431d-bc63-29510035a759 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:54.441258 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-26d55b72-8423-431d-bc63-29510035a759 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:54.447956 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26d55b72-8423-431d-bc63-29510035a759 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:54.448404 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26d55b72-8423-431d-bc63-29510035a759 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:54.449765 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26d55b72-8423-431d-bc63-29510035a759 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:54.450231 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26d55b72-8423-431d-bc63-29510035a759 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:54.581299 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-26d55b72-8423-431d-bc63-29510035a759 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:54.588717 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-26d55b72-8423-431d-bc63-29510035a759 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.153038 May 16 15:16:54.589356 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 105/217] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:54 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:55.506400 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b0340bd4-f292-4c37-8c60-727eb0b83a82 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:55.506897 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b0340bd4-f292-4c37-8c60-727eb0b83a82 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:55.513509 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0340bd4-f292-4c37-8c60-727eb0b83a82 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:55.513983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0340bd4-f292-4c37-8c60-727eb0b83a82 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:55.514878 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0340bd4-f292-4c37-8c60-727eb0b83a82 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:55.515318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0340bd4-f292-4c37-8c60-727eb0b83a82 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:55.541320 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b0340bd4-f292-4c37-8c60-727eb0b83a82 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:16:55.607991 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b43de92e-268f-4388-a9cf-bdf191110d44 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:55.608598 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b43de92e-268f-4388-a9cf-bdf191110d44 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:55.614861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b43de92e-268f-4388-a9cf-bdf191110d44 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:55.615310 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b43de92e-268f-4388-a9cf-bdf191110d44 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:55.616075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b43de92e-268f-4388-a9cf-bdf191110d44 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:55.616508 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b43de92e-268f-4388-a9cf-bdf191110d44 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:55.816684 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b43de92e-268f-4388-a9cf-bdf191110d44 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:55.831671 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b43de92e-268f-4388-a9cf-bdf191110d44 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.227441 May 16 15:16:55.832768 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 106/218] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:55 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:55.868263 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b0340bd4-f292-4c37-8c60-727eb0b83a82 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "DELETE /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 204 len: 0 microversion: 2.1 time: 0.365360 May 16 15:16:55.873875 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 113/219] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:16:55 2022] DELETE /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:16:55.878755 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-627d777f-ef74-4cef-a42d-991db1db7773 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:55.879361 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-627d777f-ef74-4cef-a42d-991db1db7773 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:55.892612 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-627d777f-ef74-4cef-a42d-991db1db7773 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:55.893055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-627d777f-ef74-4cef-a42d-991db1db7773 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:55.894811 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-627d777f-ef74-4cef-a42d-991db1db7773 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:55.895556 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-627d777f-ef74-4cef-a42d-991db1db7773 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:56.060859 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-627d777f-ef74-4cef-a42d-991db1db7773 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:56.069086 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-627d777f-ef74-4cef-a42d-991db1db7773 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1503 microversion: 2.1 time: 0.194670 May 16 15:16:56.069736 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 107/220] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:55 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:56.849252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9ed6631d-ca63-446e-ab4a-fa30a7c5850c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:56.850167 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9ed6631d-ca63-446e-ab4a-fa30a7c5850c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:56.856723 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ed6631d-ca63-446e-ab4a-fa30a7c5850c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:56.857766 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ed6631d-ca63-446e-ab4a-fa30a7c5850c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:56.858590 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ed6631d-ca63-446e-ab4a-fa30a7c5850c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:56.859459 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ed6631d-ca63-446e-ab4a-fa30a7c5850c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:57.019595 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9ed6631d-ca63-446e-ab4a-fa30a7c5850c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:57.030381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9ed6631d-ca63-446e-ab4a-fa30a7c5850c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.185278 May 16 15:16:57.031505 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 114/221] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:56 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:57.086433 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-19e04d2a-9532-415d-b823-ea1a7e4a9b39 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:57.088181 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-19e04d2a-9532-415d-b823-ea1a7e4a9b39 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:57.097083 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19e04d2a-9532-415d-b823-ea1a7e4a9b39 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:57.097789 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19e04d2a-9532-415d-b823-ea1a7e4a9b39 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:57.098852 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19e04d2a-9532-415d-b823-ea1a7e4a9b39 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:57.099431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19e04d2a-9532-415d-b823-ea1a7e4a9b39 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:57.235791 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-19e04d2a-9532-415d-b823-ea1a7e4a9b39 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:57.243401 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-19e04d2a-9532-415d-b823-ea1a7e4a9b39 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1503 microversion: 2.1 time: 0.160736 May 16 15:16:57.243971 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 108/222] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:57 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:58.047224 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6fca5921-ad44-4c95-b416-ed59a966daff tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:58.047998 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6fca5921-ad44-4c95-b416-ed59a966daff tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:58.054321 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fca5921-ad44-4c95-b416-ed59a966daff tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:58.055107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fca5921-ad44-4c95-b416-ed59a966daff tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:58.056092 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fca5921-ad44-4c95-b416-ed59a966daff tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:58.056878 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fca5921-ad44-4c95-b416-ed59a966daff tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:58.262329 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-21387091-eba2-4c7d-aa0b-1feaf5a7ab99 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:58.263284 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-21387091-eba2-4c7d-aa0b-1feaf5a7ab99 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:58.270299 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21387091-eba2-4c7d-aa0b-1feaf5a7ab99 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:58.271094 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21387091-eba2-4c7d-aa0b-1feaf5a7ab99 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:58.272030 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21387091-eba2-4c7d-aa0b-1feaf5a7ab99 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:58.272602 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21387091-eba2-4c7d-aa0b-1feaf5a7ab99 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:58.355887 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6fca5921-ad44-4c95-b416-ed59a966daff tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:58.366438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6fca5921-ad44-4c95-b416-ed59a966daff tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.322170 May 16 15:16:58.367043 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 115/223] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:58 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:58.505219 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-77d60b83-7a5c-4312-9625-a82afa174ecd req-96b32da1-71c9-42f3-bf13-d39558083d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a892b3-2c69-47f7-b9ae-503f73dde5ef", "name": "network-vif-deleted", "tag": "951fad15-ebba-4219-8b81-211bf8007b8d"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:16:58.515317 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-77d60b83-7a5c-4312-9625-a82afa174ecd req-96b32da1-71c9-42f3-bf13-d39558083d12 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:58.520373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-77d60b83-7a5c-4312-9625-a82afa174ecd req-96b32da1-71c9-42f3-bf13-d39558083d12 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:58.522990 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-21387091-eba2-4c7d-aa0b-1feaf5a7ab99 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:58.534733 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-21387091-eba2-4c7d-aa0b-1feaf5a7ab99 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1503 microversion: 2.1 time: 0.277962 May 16 15:16:58.537299 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 109/224] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:58 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:16:58.553357 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-77d60b83-7a5c-4312-9625-a82afa174ecd req-96b32da1-71c9-42f3-bf13-d39558083d12 service nova] Creating event network-vif-deleted:951fad15-ebba-4219-8b81-211bf8007b8d for instance 01a892b3-2c69-47f7-b9ae-503f73dde5ef on hv-cinder-79578 May 16 15:16:58.560150 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-77d60b83-7a5c-4312-9625-a82afa174ecd req-96b32da1-71c9-42f3-bf13-d39558083d12 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058503 May 16 15:16:58.560771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 116/225] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:16:59.395207 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aa59303b-e7a6-4fe3-833c-d8eb212ab0c4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:59.397406 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aa59303b-e7a6-4fe3-833c-d8eb212ab0c4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:59.414748 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa59303b-e7a6-4fe3-833c-d8eb212ab0c4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:59.415212 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa59303b-e7a6-4fe3-833c-d8eb212ab0c4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:59.419281 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa59303b-e7a6-4fe3-833c-d8eb212ab0c4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:59.419672 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa59303b-e7a6-4fe3-833c-d8eb212ab0c4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:59.555340 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1ca6845d-cf99-4b40-8c6b-8505189f3605 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:16:59.556041 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1ca6845d-cf99-4b40-8c6b-8505189f3605 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:16:59.573122 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1ca6845d-cf99-4b40-8c6b-8505189f3605 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:59.573975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1ca6845d-cf99-4b40-8c6b-8505189f3605 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:59.574934 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1ca6845d-cf99-4b40-8c6b-8505189f3605 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:59.575361 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1ca6845d-cf99-4b40-8c6b-8505189f3605 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:59.627374 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1ca6845d-cf99-4b40-8c6b-8505189f3605 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:16:59.627915 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1ca6845d-cf99-4b40-8c6b-8505189f3605 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:16:59.628576 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-1ca6845d-cf99-4b40-8c6b-8505189f3605 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lazy-loading 'fault' on Instance uuid 01a892b3-2c69-47f7-b9ae-503f73dde5ef {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:16:59.705186 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1ca6845d-cf99-4b40-8c6b-8505189f3605 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:59.714987 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1ca6845d-cf99-4b40-8c6b-8505189f3605 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 200 len: 1304 microversion: 2.1 time: 0.163988 May 16 15:16:59.720104 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aa59303b-e7a6-4fe3-833c-d8eb212ab0c4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:16:59.729036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 117/226] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:59 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 1304 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:16:59.739513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aa59303b-e7a6-4fe3-833c-d8eb212ab0c4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.356732 May 16 15:16:59.750463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 110/227] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:16:59 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:00.747893 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a6e0796a-c347-42e4-afd6-77445bdfea98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:00.748385 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a6e0796a-c347-42e4-afd6-77445bdfea98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 01a892b3-2c69-47f7-b9ae-503f73dde5ef] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:00.757350 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-57688648-2120-4278-80df-9474115f15d0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:00.758035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-57688648-2120-4278-80df-9474115f15d0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:00.765906 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6e0796a-c347-42e4-afd6-77445bdfea98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:00.775735 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6e0796a-c347-42e4-afd6-77445bdfea98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:00.782552 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6e0796a-c347-42e4-afd6-77445bdfea98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:00.788504 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-57688648-2120-4278-80df-9474115f15d0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:00.789078 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-57688648-2120-4278-80df-9474115f15d0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:00.790340 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6e0796a-c347-42e4-afd6-77445bdfea98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:00.796970 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-57688648-2120-4278-80df-9474115f15d0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:00.798650 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-57688648-2120-4278-80df-9474115f15d0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:00.820148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-a6e0796a-c347-42e4-afd6-77445bdfea98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] HTTP exception thrown: Instance 01a892b3-2c69-47f7-b9ae-503f73dde5ef could not be found. May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a6e0796a-c347-42e4-afd6-77445bdfea98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Request method failure captured: May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef HTTP/1.1 May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmrMis6qR3iVvik1TGioLEAN5Z8jOFvK2H4Ti6lKutjKJOnIBfCNPzBRAojTCYsVYY-aomRnNxQ1kuN44EZUN0X4PpjOtCYcTSTVm8eQykVC7UVaHKvZhAT3OHShX_I2A8YU6XhiiXBgZkkg-emZgQjMVwpWEU-gmC6WxtGZgfVmwjI May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: 7c186c3409f94fa5bb7452eee4021eea May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesActionsTest-246403111 May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:17:00.822245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7c186c3409f94fa5bb7452eee4021eea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7c186c3409f94fa5bb7452eee4021eea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7c186c3409f94fa5bb7452eee4021eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7c186c3409f94fa5bb7452eee4021eea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesActionsTest-246403111 May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 7c186c3409f94fa5bb7452eee4021eea May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesActionsTest-246403111 May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesActionsTest-246403111-project May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 665ea1968aff4e949cdf07c210e78067 May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesActionsTest-246403111-project May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance 01a892b3-2c69-47f7-b9ae-503f73dde5ef could not be found. May 16 15:17:00.824306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '01a892b3-2c69-47f7-b9ae-503f73dde5ef'} May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a892b3-2c69-47f7-b9ae-503f73dde5ef could not be found. May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:17:00.825085 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a892b3-2c69-47f7-b9ae-503f73dde5ef could not be found. May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a892b3-2c69-47f7-b9ae-503f73dde5ef could not be found. May 16 15:17:00.826426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:00.845000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a6e0796a-c347-42e4-afd6-77445bdfea98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Returning 404 to user: Instance 01a892b3-2c69-47f7-b9ae-503f73dde5ef could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:17:00.846306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a6e0796a-c347-42e4-afd6-77445bdfea98 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef" status: 404 len: 111 microversion: 2.1 time: 0.105581 May 16 15:17:00.850416 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 118/228] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:00 2022] GET /compute/v2.1/servers/01a892b3-2c69-47f7-b9ae-503f73dde5ef => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:17:01.015040 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-57688648-2120-4278-80df-9474115f15d0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:01.035581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-57688648-2120-4278-80df-9474115f15d0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.272271 May 16 15:17:01.035581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 111/229] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:00 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:01.036128 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-150986671", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "networks": [{"uuid": "6de467ee-ceef-4dff-8986-76afb32e2fd6"}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:01.101090 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] validate_networks() for [('6de467ee-ceef-4dff-8986-76afb32e2fd6', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:17:01.795947 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:17:01.796539 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:17:01.796816 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:17:01.797419 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:17:01.797824 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:17:01.807666 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:01.807666 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:01.808171 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:01.808774 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:01.826601 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Getting quotas for project 7c186c3409f94fa5bb7452eee4021eea. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:17:01.831644 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Getting quotas for user 665ea1968aff4e949cdf07c210e78067 and project 7c186c3409f94fa5bb7452eee4021eea. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:17:01.843396 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:17:01.845684 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:17:02.042264 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-985b476e-65b7-49bb-a5ac-3e315e5635bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:02.043396 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-985b476e-65b7-49bb-a5ac-3e315e5635bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:02.049925 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-985b476e-65b7-49bb-a5ac-3e315e5635bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:02.050398 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-985b476e-65b7-49bb-a5ac-3e315e5635bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:02.051198 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-985b476e-65b7-49bb-a5ac-3e315e5635bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:02.051612 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-985b476e-65b7-49bb-a5ac-3e315e5635bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:02.056971 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1f31f056-3ac3-4b0e-8613-e2bdd59a9982 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.029000 May 16 15:17:02.063402 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 119/230] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:17:02.069518 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-805c43b3-de48-453d-8699-469fb03ec647 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:02.071039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-805c43b3-de48-453d-8699-469fb03ec647 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:02.165458 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-805c43b3-de48-453d-8699-469fb03ec647 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:02.194248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-805c43b3-de48-453d-8699-469fb03ec647 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1213 microversion: 2.1 time: 0.123523 May 16 15:17:02.194248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 120/231] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:02 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:02.241400 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a5f99f1d-5ddf-4318-a5dd-847bcc8f7126 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:02.241895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a5f99f1d-5ddf-4318-a5dd-847bcc8f7126 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:02.251919 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5f99f1d-5ddf-4318-a5dd-847bcc8f7126 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:02.258514 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5f99f1d-5ddf-4318-a5dd-847bcc8f7126 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:02.258514 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5f99f1d-5ddf-4318-a5dd-847bcc8f7126 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:02.258514 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5f99f1d-5ddf-4318-a5dd-847bcc8f7126 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:02.297176 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-985b476e-65b7-49bb-a5ac-3e315e5635bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:02.305446 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-985b476e-65b7-49bb-a5ac-3e315e5635bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.267029 May 16 15:17:02.307452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a5f99f1d-5ddf-4318-a5dd-847bcc8f7126 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/ips" status: 200 len: 149 microversion: 2.1 time: 0.070686 May 16 15:17:02.327395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 112/233] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:02 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:02.327491 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 121/233] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 16 15:17:02 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/ips => generated 149 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:03.207373 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aab32576-2d0a-4eed-b6c4-e6a291794e75 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:03.209036 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aab32576-2d0a-4eed-b6c4-e6a291794e75 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:03.216935 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aab32576-2d0a-4eed-b6c4-e6a291794e75 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:03.217822 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aab32576-2d0a-4eed-b6c4-e6a291794e75 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:03.218848 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aab32576-2d0a-4eed-b6c4-e6a291794e75 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:03.219490 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aab32576-2d0a-4eed-b6c4-e6a291794e75 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:03.295082 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aab32576-2d0a-4eed-b6c4-e6a291794e75 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:03.302653 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aab32576-2d0a-4eed-b6c4-e6a291794e75 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1217 microversion: 2.1 time: 0.100106 May 16 15:17:03.303787 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 113/234] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:03 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:03.328533 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-936713af-4113-4dfd-b0d7-8110e8bb70bc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:03.329150 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-936713af-4113-4dfd-b0d7-8110e8bb70bc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:03.346046 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-936713af-4113-4dfd-b0d7-8110e8bb70bc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:03.346740 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-936713af-4113-4dfd-b0d7-8110e8bb70bc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:03.347875 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-936713af-4113-4dfd-b0d7-8110e8bb70bc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:03.348457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-936713af-4113-4dfd-b0d7-8110e8bb70bc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:03.556664 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-936713af-4113-4dfd-b0d7-8110e8bb70bc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:03.566787 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-936713af-4113-4dfd-b0d7-8110e8bb70bc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.248830 May 16 15:17:03.568897 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 122/235] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:03 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:04.258004 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-49d4ec84-16bf-4e37-9547-3d1e74b2b9e2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "320cd733-cfef-4c6d-98ec-3f88a526e053"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:04.260039 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-49d4ec84-16bf-4e37-9547-3d1e74b2b9e2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:04.268797 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49d4ec84-16bf-4e37-9547-3d1e74b2b9e2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:04.272434 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49d4ec84-16bf-4e37-9547-3d1e74b2b9e2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:04.272434 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49d4ec84-16bf-4e37-9547-3d1e74b2b9e2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:04.272434 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49d4ec84-16bf-4e37-9547-3d1e74b2b9e2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:04.322022 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-96d36b62-6844-4bfc-b0aa-cfb345bd4b40 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:04.323531 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-96d36b62-6844-4bfc-b0aa-cfb345bd4b40 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:04.339623 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96d36b62-6844-4bfc-b0aa-cfb345bd4b40 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:04.341674 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96d36b62-6844-4bfc-b0aa-cfb345bd4b40 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:04.341674 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96d36b62-6844-4bfc-b0aa-cfb345bd4b40 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:04.341674 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96d36b62-6844-4bfc-b0aa-cfb345bd4b40 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:04.436474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-96d36b62-6844-4bfc-b0aa-cfb345bd4b40 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:04.445477 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-96d36b62-6844-4bfc-b0aa-cfb345bd4b40 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1265 microversion: 2.1 time: 0.128320 May 16 15:17:04.472450 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 123/236] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:04 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:04.584834 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-56695a63-a63c-4b21-8657-adf520fdb309 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:04.585443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-56695a63-a63c-4b21-8657-adf520fdb309 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:04.591986 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56695a63-a63c-4b21-8657-adf520fdb309 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:04.592436 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56695a63-a63c-4b21-8657-adf520fdb309 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:04.593259 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56695a63-a63c-4b21-8657-adf520fdb309 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:04.593714 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56695a63-a63c-4b21-8657-adf520fdb309 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:04.774318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-56695a63-a63c-4b21-8657-adf520fdb309 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:04.785924 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-56695a63-a63c-4b21-8657-adf520fdb309 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.204390 May 16 15:17:04.786815 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 124/237] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:04 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:05.455842 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-49d4ec84-16bf-4e37-9547-3d1e74b2b9e2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.203142 May 16 15:17:05.456783 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 114/238] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:17:04 2022] POST /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-volume_attachments => generated 194 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:05.488775 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7567a386-c531-425a-b3c0-5c72889aa0e9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:05.489385 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7567a386-c531-425a-b3c0-5c72889aa0e9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:05.498288 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7567a386-c531-425a-b3c0-5c72889aa0e9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:05.498787 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7567a386-c531-425a-b3c0-5c72889aa0e9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:05.506219 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7567a386-c531-425a-b3c0-5c72889aa0e9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:05.506675 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7567a386-c531-425a-b3c0-5c72889aa0e9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:05.643024 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7567a386-c531-425a-b3c0-5c72889aa0e9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:05.654643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7567a386-c531-425a-b3c0-5c72889aa0e9 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1271 microversion: 2.1 time: 0.169622 May 16 15:17:05.657913 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 125/239] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:05 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:05.807894 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d4b14f22-6c48-47b7-834c-f28dfe196c5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:05.808957 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d4b14f22-6c48-47b7-834c-f28dfe196c5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:05.828563 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4b14f22-6c48-47b7-834c-f28dfe196c5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:05.829378 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4b14f22-6c48-47b7-834c-f28dfe196c5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:05.830680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4b14f22-6c48-47b7-834c-f28dfe196c5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:05.831309 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4b14f22-6c48-47b7-834c-f28dfe196c5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:06.455254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d4b14f22-6c48-47b7-834c-f28dfe196c5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:06.465090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d4b14f22-6c48-47b7-834c-f28dfe196c5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.663703 May 16 15:17:06.474289 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 115/240] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:05 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:06.674853 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-70aa0a27-23c1-4ee8-8fd8-aad4a86021c8 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:06.675453 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-70aa0a27-23c1-4ee8-8fd8-aad4a86021c8 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:06.692973 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-70aa0a27-23c1-4ee8-8fd8-aad4a86021c8 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:06.693960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-70aa0a27-23c1-4ee8-8fd8-aad4a86021c8 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:06.694764 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-70aa0a27-23c1-4ee8-8fd8-aad4a86021c8 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:06.695195 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-70aa0a27-23c1-4ee8-8fd8-aad4a86021c8 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:06.902115 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-70aa0a27-23c1-4ee8-8fd8-aad4a86021c8 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:06.912345 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-70aa0a27-23c1-4ee8-8fd8-aad4a86021c8 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.240738 May 16 15:17:06.913494 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 126/241] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:06 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:07.483536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5078f28b-52ae-474b-b8e8-ff7efd5494fb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:07.489005 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5078f28b-52ae-474b-b8e8-ff7efd5494fb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:07.505550 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5078f28b-52ae-474b-b8e8-ff7efd5494fb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:07.506106 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5078f28b-52ae-474b-b8e8-ff7efd5494fb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:07.506975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5078f28b-52ae-474b-b8e8-ff7efd5494fb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:07.507515 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5078f28b-52ae-474b-b8e8-ff7efd5494fb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:07.744107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5078f28b-52ae-474b-b8e8-ff7efd5494fb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:07.754909 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5078f28b-52ae-474b-b8e8-ff7efd5494fb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.275335 May 16 15:17:07.756113 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 116/242] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:07 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:07.930202 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f979f518-0725-407f-9652-48aaf6ae12d6 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:07.931447 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f979f518-0725-407f-9652-48aaf6ae12d6 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:07.938592 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f979f518-0725-407f-9652-48aaf6ae12d6 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:07.939278 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f979f518-0725-407f-9652-48aaf6ae12d6 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:07.940293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f979f518-0725-407f-9652-48aaf6ae12d6 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:07.940954 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f979f518-0725-407f-9652-48aaf6ae12d6 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:08.223976 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f979f518-0725-407f-9652-48aaf6ae12d6 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:08.237213 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f979f518-0725-407f-9652-48aaf6ae12d6 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.310234 May 16 15:17:08.239626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 127/243] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:07 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:08.772659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-94e799b7-bc8d-4a08-8f40-29c64aa6a614 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:08.773290 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-94e799b7-bc8d-4a08-8f40-29c64aa6a614 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:08.780434 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94e799b7-bc8d-4a08-8f40-29c64aa6a614 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:08.781165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94e799b7-bc8d-4a08-8f40-29c64aa6a614 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:08.782290 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94e799b7-bc8d-4a08-8f40-29c64aa6a614 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:08.782880 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94e799b7-bc8d-4a08-8f40-29c64aa6a614 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:08.984797 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-b31da81c-927d-4901-b0a8-4bd9b410547f req-51536170-60c2-4589-af41-10781bf7763a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79fde843-2868-4a1f-a344-df85fd7b1e70", "tag": "55dcbab2-a484-491c-8320-1c3a8ba319b8"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:09.009496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-b31da81c-927d-4901-b0a8-4bd9b410547f req-51536170-60c2-4589-af41-10781bf7763a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:09.010512 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-b31da81c-927d-4901-b0a8-4bd9b410547f req-51536170-60c2-4589-af41-10781bf7763a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:09.024992 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-94e799b7-bc8d-4a08-8f40-29c64aa6a614 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:09.035059 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-94e799b7-bc8d-4a08-8f40-29c64aa6a614 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.265951 May 16 15:17:09.045351 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-b31da81c-927d-4901-b0a8-4bd9b410547f req-51536170-60c2-4589-af41-10781bf7763a service nova] Creating event network-changed:55dcbab2-a484-491c-8320-1c3a8ba319b8 for instance 79fde843-2868-4a1f-a344-df85fd7b1e70 on hv-cinder-79578 May 16 15:17:09.045731 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 117/244] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:08 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:09.054489 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-b31da81c-927d-4901-b0a8-4bd9b410547f req-51536170-60c2-4589-af41-10781bf7763a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073529 May 16 15:17:09.055643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 128/245] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:17:09.255661 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-38fb1579-ce26-4717-93de-b8e8ae5f175d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:09.256466 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-38fb1579-ce26-4717-93de-b8e8ae5f175d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:09.263105 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38fb1579-ce26-4717-93de-b8e8ae5f175d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:09.263935 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38fb1579-ce26-4717-93de-b8e8ae5f175d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:09.264748 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38fb1579-ce26-4717-93de-b8e8ae5f175d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:09.265395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38fb1579-ce26-4717-93de-b8e8ae5f175d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:09.677231 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-38fb1579-ce26-4717-93de-b8e8ae5f175d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:09.697576 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-38fb1579-ce26-4717-93de-b8e8ae5f175d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.445614 May 16 15:17:09.701670 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 118/246] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:09 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:10.053678 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a6231041-a3ec-4391-8880-5736421f74d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:10.054569 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a6231041-a3ec-4391-8880-5736421f74d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:10.067821 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6231041-a3ec-4391-8880-5736421f74d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:10.070788 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6231041-a3ec-4391-8880-5736421f74d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:10.073636 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6231041-a3ec-4391-8880-5736421f74d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:10.075099 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6231041-a3ec-4391-8880-5736421f74d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:10.319637 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a6231041-a3ec-4391-8880-5736421f74d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:10.331224 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a6231041-a3ec-4391-8880-5736421f74d3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.280432 May 16 15:17:10.348185 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 129/247] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:10 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:10.717844 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-469df75e-e664-4282-b96c-a0e7e4b06467 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:10.719179 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-469df75e-e664-4282-b96c-a0e7e4b06467 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:10.732533 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-469df75e-e664-4282-b96c-a0e7e4b06467 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:10.735162 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-469df75e-e664-4282-b96c-a0e7e4b06467 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:10.737007 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-469df75e-e664-4282-b96c-a0e7e4b06467 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:10.738099 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-469df75e-e664-4282-b96c-a0e7e4b06467 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:11.004803 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-469df75e-e664-4282-b96c-a0e7e4b06467 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:11.014476 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-469df75e-e664-4282-b96c-a0e7e4b06467 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.303413 May 16 15:17:11.015052 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 119/248] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:10 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:11.354969 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a5898f08-8fc5-4462-bd3c-49a83b2fad5e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:11.355762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a5898f08-8fc5-4462-bd3c-49a83b2fad5e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:11.362400 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5898f08-8fc5-4462-bd3c-49a83b2fad5e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:11.362919 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5898f08-8fc5-4462-bd3c-49a83b2fad5e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:11.363767 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5898f08-8fc5-4462-bd3c-49a83b2fad5e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:11.364253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5898f08-8fc5-4462-bd3c-49a83b2fad5e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:11.526429 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a5898f08-8fc5-4462-bd3c-49a83b2fad5e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:11.539278 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a5898f08-8fc5-4462-bd3c-49a83b2fad5e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.188700 May 16 15:17:11.540521 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 130/249] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:11 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:12.032873 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-73893ae4-0572-47c3-b01c-6df3b37e81f3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:12.033478 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-73893ae4-0572-47c3-b01c-6df3b37e81f3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:12.065022 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-73893ae4-0572-47c3-b01c-6df3b37e81f3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:12.068267 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-73893ae4-0572-47c3-b01c-6df3b37e81f3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:12.070430 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-73893ae4-0572-47c3-b01c-6df3b37e81f3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:12.070943 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-73893ae4-0572-47c3-b01c-6df3b37e81f3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:12.305614 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-73893ae4-0572-47c3-b01c-6df3b37e81f3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:12.330127 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-73893ae4-0572-47c3-b01c-6df3b37e81f3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.300795 May 16 15:17:12.411327 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 120/250] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:12 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:12.593556 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9cd8635f-cc12-492a-ab5d-6f5f9b7f1ab2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:12.593556 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9cd8635f-cc12-492a-ab5d-6f5f9b7f1ab2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:12.593556 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cd8635f-cc12-492a-ab5d-6f5f9b7f1ab2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:12.593556 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cd8635f-cc12-492a-ab5d-6f5f9b7f1ab2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:12.594293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cd8635f-cc12-492a-ab5d-6f5f9b7f1ab2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:12.594293 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cd8635f-cc12-492a-ab5d-6f5f9b7f1ab2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:12.757662 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9cd8635f-cc12-492a-ab5d-6f5f9b7f1ab2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:12.765000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9cd8635f-cc12-492a-ab5d-6f5f9b7f1ab2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.212004 May 16 15:17:12.778141 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 131/251] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:12 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:13.347271 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4182da2e-6318-4da3-a70c-c6a1cc09c35d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:13.347889 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4182da2e-6318-4da3-a70c-c6a1cc09c35d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:13.354307 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4182da2e-6318-4da3-a70c-c6a1cc09c35d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:13.355041 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4182da2e-6318-4da3-a70c-c6a1cc09c35d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:13.356025 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4182da2e-6318-4da3-a70c-c6a1cc09c35d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:13.356662 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4182da2e-6318-4da3-a70c-c6a1cc09c35d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:13.557664 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4182da2e-6318-4da3-a70c-c6a1cc09c35d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:13.572312 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4182da2e-6318-4da3-a70c-c6a1cc09c35d tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.228822 May 16 15:17:13.573072 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 121/252] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:13 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:13.787907 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-20450c7d-42c8-4eeb-ae68-beb47eefbdf2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:13.790253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-20450c7d-42c8-4eeb-ae68-beb47eefbdf2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:13.813975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20450c7d-42c8-4eeb-ae68-beb47eefbdf2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:13.815342 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20450c7d-42c8-4eeb-ae68-beb47eefbdf2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:13.817638 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20450c7d-42c8-4eeb-ae68-beb47eefbdf2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:13.819603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20450c7d-42c8-4eeb-ae68-beb47eefbdf2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:14.080125 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-20450c7d-42c8-4eeb-ae68-beb47eefbdf2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:14.095111 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-20450c7d-42c8-4eeb-ae68-beb47eefbdf2 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.312160 May 16 15:17:14.107562 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 132/253] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:13 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:14.551245 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5250fb4c-a93a-4e1e-8102-ad6c86964724 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:14.551842 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5250fb4c-a93a-4e1e-8102-ad6c86964724 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:14.563453 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5250fb4c-a93a-4e1e-8102-ad6c86964724 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:14.563905 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5250fb4c-a93a-4e1e-8102-ad6c86964724 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:14.564684 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5250fb4c-a93a-4e1e-8102-ad6c86964724 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:14.567080 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5250fb4c-a93a-4e1e-8102-ad6c86964724 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:14.607015 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-40dc2b1b-80cd-4a36-8166-6b184c60c0b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:14.611343 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-40dc2b1b-80cd-4a36-8166-6b184c60c0b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:14.654519 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40dc2b1b-80cd-4a36-8166-6b184c60c0b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:14.658512 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40dc2b1b-80cd-4a36-8166-6b184c60c0b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:14.660474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40dc2b1b-80cd-4a36-8166-6b184c60c0b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:14.660997 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40dc2b1b-80cd-4a36-8166-6b184c60c0b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:14.750643 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5250fb4c-a93a-4e1e-8102-ad6c86964724 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/ips" status: 200 len: 146 microversion: 2.1 time: 0.176896 May 16 15:17:14.751259 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 122/254] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 16 15:17:14 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/ips => generated 146 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:14.997263 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-40dc2b1b-80cd-4a36-8166-6b184c60c0b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:15.010384 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-40dc2b1b-80cd-4a36-8166-6b184c60c0b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.414449 May 16 15:17:15.015345 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 133/255] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:14 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:15.112693 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7b0023fd-4adb-4f2f-83fb-18c4e051bd2f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:15.113340 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7b0023fd-4adb-4f2f-83fb-18c4e051bd2f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:15.119922 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b0023fd-4adb-4f2f-83fb-18c4e051bd2f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:15.120370 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b0023fd-4adb-4f2f-83fb-18c4e051bd2f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:15.121131 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b0023fd-4adb-4f2f-83fb-18c4e051bd2f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:15.121559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b0023fd-4adb-4f2f-83fb-18c4e051bd2f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:15.417097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7b0023fd-4adb-4f2f-83fb-18c4e051bd2f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:15.443190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7b0023fd-4adb-4f2f-83fb-18c4e051bd2f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.330991 May 16 15:17:15.446012 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 123/256] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:15 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:16.030533 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-15f37dde-4d7e-4a3f-a4d4-a016f46a419e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:16.040993 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-15f37dde-4d7e-4a3f-a4d4-a016f46a419e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:16.047391 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-15f37dde-4d7e-4a3f-a4d4-a016f46a419e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:16.048548 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-15f37dde-4d7e-4a3f-a4d4-a016f46a419e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:16.051296 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-15f37dde-4d7e-4a3f-a4d4-a016f46a419e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:16.055619 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-15f37dde-4d7e-4a3f-a4d4-a016f46a419e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:16.391793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-15f37dde-4d7e-4a3f-a4d4-a016f46a419e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:16.400574 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-15f37dde-4d7e-4a3f-a4d4-a016f46a419e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.374232 May 16 15:17:16.401384 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 134/257] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:16 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:16.460781 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e86b4058-5d26-4e4f-88cb-36c29e1f18d8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:16.467619 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e86b4058-5d26-4e4f-88cb-36c29e1f18d8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:16.469386 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e86b4058-5d26-4e4f-88cb-36c29e1f18d8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:16.469899 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e86b4058-5d26-4e4f-88cb-36c29e1f18d8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:16.470708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e86b4058-5d26-4e4f-88cb-36c29e1f18d8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:16.471184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e86b4058-5d26-4e4f-88cb-36c29e1f18d8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:16.614136 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e86b4058-5d26-4e4f-88cb-36c29e1f18d8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:16.619515 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e86b4058-5d26-4e4f-88cb-36c29e1f18d8 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.161939 May 16 15:17:16.629507 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 124/258] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:16 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:17.422722 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9cf78967-35b6-4a66-ad43-4965137deb26 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:17.424797 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9cf78967-35b6-4a66-ad43-4965137deb26 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:17.459180 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cf78967-35b6-4a66-ad43-4965137deb26 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:17.466325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cf78967-35b6-4a66-ad43-4965137deb26 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:17.467210 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cf78967-35b6-4a66-ad43-4965137deb26 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:17.467629 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cf78967-35b6-4a66-ad43-4965137deb26 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:17.638693 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-083324f4-a0d3-434e-95ac-e4c1bd3c002e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:17.639272 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-083324f4-a0d3-434e-95ac-e4c1bd3c002e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:17.650818 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-083324f4-a0d3-434e-95ac-e4c1bd3c002e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:17.654845 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-083324f4-a0d3-434e-95ac-e4c1bd3c002e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:17.655746 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-083324f4-a0d3-434e-95ac-e4c1bd3c002e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:17.656159 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-083324f4-a0d3-434e-95ac-e4c1bd3c002e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:17.864494 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9cf78967-35b6-4a66-ad43-4965137deb26 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:17.873160 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9cf78967-35b6-4a66-ad43-4965137deb26 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.457974 May 16 15:17:17.895952 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 135/259] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:17 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:18.027038 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-083324f4-a0d3-434e-95ac-e4c1bd3c002e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:18.041832 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-083324f4-a0d3-434e-95ac-e4c1bd3c002e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.410074 May 16 15:17:18.053324 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 125/260] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:17 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:18.292959 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7dac8134-def9-4cde-83ac-21769e42d8a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f29d1c95-e9d3-4efb-9a7a-97eed3a7ef28"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:18.297028 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7dac8134-def9-4cde-83ac-21769e42d8a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:18.331305 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7dac8134-def9-4cde-83ac-21769e42d8a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:18.336716 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7dac8134-def9-4cde-83ac-21769e42d8a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:18.338846 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7dac8134-def9-4cde-83ac-21769e42d8a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:18.339510 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7dac8134-def9-4cde-83ac-21769e42d8a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:18.906653 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-76c961ca-5659-44b9-a0d4-72e4e728ace5 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:18.908221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-76c961ca-5659-44b9-a0d4-72e4e728ace5 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:18.919453 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76c961ca-5659-44b9-a0d4-72e4e728ace5 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:18.920482 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76c961ca-5659-44b9-a0d4-72e4e728ace5 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:18.921962 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76c961ca-5659-44b9-a0d4-72e4e728ace5 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:18.922662 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76c961ca-5659-44b9-a0d4-72e4e728ace5 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:19.121100 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-76c961ca-5659-44b9-a0d4-72e4e728ace5 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:19.133465 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-76c961ca-5659-44b9-a0d4-72e4e728ace5 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.234605 May 16 15:17:19.134582 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 126/261] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:18 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:19.165881 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dffc766e-93af-498d-9f0e-cd4ff74b14e7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: .version_select at 0x7fc9a7eb8790>, body: {"keypair": {"name": "tempest-keypair-211185076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBQEBcvntieBR61lAulfMoBe2dPRPRtHRuOdsg+bVsXSoD7fd39U8o5J+e/Cu+5vrm4TeLU1FDYsgs2fbgsgAqRA2g6HZZRvfg5J5RHQwqkxhY8gw11UnkHjIDNp6NhGA=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:19.242557 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-dffc766e-93af-498d-9f0e-cd4ff74b14e7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for project d143bc5a616249a7beefc7b27962026b. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:17:19.249188 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-dffc766e-93af-498d-9f0e-cd4ff74b14e7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for user 44ffd5660baa40a7a3d6918cb5d31e56 and project d143bc5a616249a7beefc7b27962026b. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:17:19.369682 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dffc766e-93af-498d-9f0e-cd4ff74b14e7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.212918 May 16 15:17:19.370511 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 127/262] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 16 15:17:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:19.375214 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fa8cb375-8b5c-45bb-96ef-af0a135c9197 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:19.376077 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fa8cb375-8b5c-45bb-96ef-af0a135c9197 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:19.396943 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa8cb375-8b5c-45bb-96ef-af0a135c9197 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:19.398423 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa8cb375-8b5c-45bb-96ef-af0a135c9197 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:19.401568 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa8cb375-8b5c-45bb-96ef-af0a135c9197 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:19.402369 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa8cb375-8b5c-45bb-96ef-af0a135c9197 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:19.593538 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fa8cb375-8b5c-45bb-96ef-af0a135c9197 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:19.602832 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fa8cb375-8b5c-45bb-96ef-af0a135c9197 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.230950 May 16 15:17:19.603901 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 128/263] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:19 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:19.823060 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7dac8134-def9-4cde-83ac-21769e42d8a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "POST /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.538343 May 16 15:17:19.836814 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 136/264] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:17:18 2022] POST /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/os-volume_attachments => generated 194 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:19.917575 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-046c1de3-dc6d-47ab-9e4a-e8d3ffb53b51 req-497494b6-1f2c-44c6-baa5-2440fc645553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79fde843-2868-4a1f-a344-df85fd7b1e70", "name": "network-vif-plugged", "status": "completed", "tag": "55dcbab2-a484-491c-8320-1c3a8ba319b8"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:19.922501 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-046c1de3-dc6d-47ab-9e4a-e8d3ffb53b51 req-497494b6-1f2c-44c6-baa5-2440fc645553 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:19.922939 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-046c1de3-dc6d-47ab-9e4a-e8d3ffb53b51 req-497494b6-1f2c-44c6-baa5-2440fc645553 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:19.936395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-046c1de3-dc6d-47ab-9e4a-e8d3ffb53b51 req-497494b6-1f2c-44c6-baa5-2440fc645553 service nova] Creating event network-vif-plugged:55dcbab2-a484-491c-8320-1c3a8ba319b8 for instance 79fde843-2868-4a1f-a344-df85fd7b1e70 on hv-cinder-79578 May 16 15:17:19.942015 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-046c1de3-dc6d-47ab-9e4a-e8d3ffb53b51 req-497494b6-1f2c-44c6-baa5-2440fc645553 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033169 May 16 15:17:19.943092 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 129/265] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:20.169613 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3c1b011c-66f5-49f1-86ba-4ab48d42aed1 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:20.171753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3c1b011c-66f5-49f1-86ba-4ab48d42aed1 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:20.193152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3c1b011c-66f5-49f1-86ba-4ab48d42aed1 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.193956 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3c1b011c-66f5-49f1-86ba-4ab48d42aed1 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.195014 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3c1b011c-66f5-49f1-86ba-4ab48d42aed1 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.195659 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3c1b011c-66f5-49f1-86ba-4ab48d42aed1 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.426400 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3c1b011c-66f5-49f1-86ba-4ab48d42aed1 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:20.442120 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3c1b011c-66f5-49f1-86ba-4ab48d42aed1 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.290352 May 16 15:17:20.458543 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 137/266] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:20 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:20.620559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2cb7d07e-5355-47a6-a05e-b5d96466d672 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:20.621250 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2cb7d07e-5355-47a6-a05e-b5d96466d672 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:20.657255 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2cb7d07e-5355-47a6-a05e-b5d96466d672 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.657812 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2cb7d07e-5355-47a6-a05e-b5d96466d672 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.658602 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2cb7d07e-5355-47a6-a05e-b5d96466d672 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.659027 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2cb7d07e-5355-47a6-a05e-b5d96466d672 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.958351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2cb7d07e-5355-47a6-a05e-b5d96466d672 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:20.958351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2cb7d07e-5355-47a6-a05e-b5d96466d672 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1502 microversion: 2.1 time: 0.297398 May 16 15:17:20.958351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 130/267] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:20 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1502 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:20.959157 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-80fb910c-f3c1-46b8-baff-cdb04a3d0afb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4edbd861-81e7-439f-ac17-a3eeaae39761"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:20.959157 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-80fb910c-f3c1-46b8-baff-cdb04a3d0afb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:20.959157 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80fb910c-f3c1-46b8-baff-cdb04a3d0afb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.959157 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80fb910c-f3c1-46b8-baff-cdb04a3d0afb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.959880 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80fb910c-f3c1-46b8-baff-cdb04a3d0afb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.959880 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80fb910c-f3c1-46b8-baff-cdb04a3d0afb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.965998 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-80fb910c-f3c1-46b8-baff-cdb04a3d0afb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] HTTP exception thrown: Cannot 'attach_volume' instance b8cc0b00-99f9-4486-b349-f60a0d2db023 while it is in vm_state rescued May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-80fb910c-f3c1-46b8-baff-cdb04a3d0afb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Request method failure captured: May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: POST /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023/os-volume_attachments HTTP/1.1 May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 74 May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqK54J41Q5ZxL_QyU-Q-VZdGq9UCScERyQ6w5yYqjVfeWLE0oqK7Gtv2tI5XRhcO1owfgkx6gaoy5Peo_zqyhv_hAxXy3uv_aE0iP8V5OUb4aJoKYMnErP71VH-vqCJkoqC0-9pCtMo-qvAEAPKOEkdMYHcMu8OjF3oWoy4aipwXlQ May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: 316917d7a31645bfaac651f81154c18f May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:17:20.968307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/316917d7a31645bfaac651f81154c18f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/316917d7a31645bfaac651f81154c18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/316917d7a31645bfaac651f81154c18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_316917d7a31645bfaac651f81154c18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 316917d7a31645bfaac651f81154c18f May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-ServerRescueNegativeTestJSON-1789909565-project May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: a14795cb97ac44b2a7fc1e2f79b12253 May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1789909565-project May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {"volumeAttachment": {"volumeId": "4edbd861-81e7-439f-ac17-a3eeaae39761"}} May 16 15:17:20.969763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Cannot 'attach_volume' instance b8cc0b00-99f9-4486-b349-f60a0d2db023 while it is in vm_state rescued May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'server_id': 'b8cc0b00-99f9-4486-b349-f60a0d2db023', 'body': {'volumeAttachment': {'volumeId': '4edbd861-81e7-439f-ac17-a3eeaae39761'}}} May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b8cc0b00-99f9-4486-b349-f60a0d2db023 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:17:20.970742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b8cc0b00-99f9-4486-b349-f60a0d2db023 while it is in vm_state rescued May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:17:20.972153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:17:20.973448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:17:20.973448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:17:20.973448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b8cc0b00-99f9-4486-b349-f60a0d2db023 while it is in vm_state rescued May 16 15:17:20.973448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:20.973448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-80fb910c-f3c1-46b8-baff-cdb04a3d0afb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Returning 409 to user: Cannot 'attach_volume' instance b8cc0b00-99f9-4486-b349-f60a0d2db023 while it is in vm_state rescued {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:17:20.973448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-80fb910c-f3c1-46b8-baff-cdb04a3d0afb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "POST /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043046 May 16 15:17:20.973448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 138/268] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:17:20 2022] POST /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 15:17:20.979236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1569d00a-1815-4837-baf6-437b2dbaa55a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:20.979800 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1569d00a-1815-4837-baf6-437b2dbaa55a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:20.986786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1569d00a-1815-4837-baf6-437b2dbaa55a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.987442 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1569d00a-1815-4837-baf6-437b2dbaa55a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:20.988225 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1569d00a-1815-4837-baf6-437b2dbaa55a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:20.988660 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1569d00a-1815-4837-baf6-437b2dbaa55a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:21.460573 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fee4a05b-bf2b-4bdc-858e-6dc1d0cde17f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:21.461183 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fee4a05b-bf2b-4bdc-858e-6dc1d0cde17f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:21.469098 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fee4a05b-bf2b-4bdc-858e-6dc1d0cde17f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:21.470164 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fee4a05b-bf2b-4bdc-858e-6dc1d0cde17f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:21.477741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fee4a05b-bf2b-4bdc-858e-6dc1d0cde17f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:21.479303 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fee4a05b-bf2b-4bdc-858e-6dc1d0cde17f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:21.494304 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1569d00a-1815-4837-baf6-437b2dbaa55a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "POST /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023/action" status: 202 len: 0 microversion: 2.1 time: 0.517843 May 16 15:17:21.499041 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 131/269] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:17:20 2022] POST /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:17:21.508080 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7d6408b4-a4be-401c-8fd8-01a7cec6bf65 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:21.510972 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7d6408b4-a4be-401c-8fd8-01a7cec6bf65 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:21.529086 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d6408b4-a4be-401c-8fd8-01a7cec6bf65 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:21.529702 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d6408b4-a4be-401c-8fd8-01a7cec6bf65 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:21.533046 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d6408b4-a4be-401c-8fd8-01a7cec6bf65 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:21.533830 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d6408b4-a4be-401c-8fd8-01a7cec6bf65 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:21.869476 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7d6408b4-a4be-401c-8fd8-01a7cec6bf65 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:21.877640 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fee4a05b-bf2b-4bdc-858e-6dc1d0cde17f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:21.889271 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7d6408b4-a4be-401c-8fd8-01a7cec6bf65 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1510 microversion: 2.1 time: 0.385382 May 16 15:17:21.890019 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 132/270] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:21 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:21.893217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fee4a05b-bf2b-4bdc-858e-6dc1d0cde17f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1313 microversion: 2.1 time: 0.436427 May 16 15:17:21.895314 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 139/271] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:21 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:22.908492 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b2e1b554-7697-458b-8665-7f143815e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:22.909107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b2e1b554-7697-458b-8665-7f143815e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:22.920562 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d1f64e72-72bd-4554-9ec2-684153bc18b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:22.921812 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d1f64e72-72bd-4554-9ec2-684153bc18b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:22.924790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2e1b554-7697-458b-8665-7f143815e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:22.929643 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2e1b554-7697-458b-8665-7f143815e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:22.930773 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2e1b554-7697-458b-8665-7f143815e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:22.935311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2e1b554-7697-458b-8665-7f143815e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:22.942022 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d1f64e72-72bd-4554-9ec2-684153bc18b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:22.942981 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d1f64e72-72bd-4554-9ec2-684153bc18b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:22.944387 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d1f64e72-72bd-4554-9ec2-684153bc18b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:22.944983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d1f64e72-72bd-4554-9ec2-684153bc18b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:23.174087 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d1f64e72-72bd-4554-9ec2-684153bc18b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:23.190905 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d1f64e72-72bd-4554-9ec2-684153bc18b7 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1496 microversion: 2.1 time: 0.275928 May 16 15:17:23.191839 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 140/272] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:22 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1496 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:23.444715 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b2e1b554-7697-458b-8665-7f143815e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:23.468919 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b2e1b554-7697-458b-8665-7f143815e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1510 microversion: 2.1 time: 0.550707 May 16 15:17:23.468919 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 133/273] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:22 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:23.841129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-180853463", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "982c6e92-7848-46dd-811d-5ec569a6da67"}], "security_groups": [{"name": "tempest-securitygroup--789117430"}], "key_name": "tempest-keypair-211185076", "user_data": "}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:24.488824 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ef7aedad-5862-4d51-8091-382c5e0d66da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:24.489492 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ef7aedad-5862-4d51-8091-382c5e0d66da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:24.500954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef7aedad-5862-4d51-8091-382c5e0d66da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:24.501403 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef7aedad-5862-4d51-8091-382c5e0d66da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:24.505991 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef7aedad-5862-4d51-8091-382c5e0d66da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:24.507266 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef7aedad-5862-4d51-8091-382c5e0d66da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:24.834659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ef7aedad-5862-4d51-8091-382c5e0d66da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:24.846783 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ef7aedad-5862-4d51-8091-382c5e0d66da tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1510 microversion: 2.1 time: 0.369528 May 16 15:17:24.850568 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 134/274] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:24 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1510 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:24.856976 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aee92bbc-d059-4de0-a1b1-49c1aab7d1b3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:24.857782 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aee92bbc-d059-4de0-a1b1-49c1aab7d1b3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:24.864629 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aee92bbc-d059-4de0-a1b1-49c1aab7d1b3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:24.865422 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aee92bbc-d059-4de0-a1b1-49c1aab7d1b3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:24.866669 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aee92bbc-d059-4de0-a1b1-49c1aab7d1b3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:24.870067 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aee92bbc-d059-4de0-a1b1-49c1aab7d1b3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:24.904920 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aee92bbc-d059-4de0-a1b1-49c1aab7d1b3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:17:25.768356 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aee92bbc-d059-4de0-a1b1-49c1aab7d1b3 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "DELETE /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 204 len: 0 microversion: 2.1 time: 0.914878 May 16 15:17:25.774153 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 135/275] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:17:24 2022] DELETE /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:17:25.782203 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-efaace45-7d83-4ba9-b60f-ae1d33d7710e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:25.783242 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-efaace45-7d83-4ba9-b60f-ae1d33d7710e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:25.790884 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efaace45-7d83-4ba9-b60f-ae1d33d7710e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:25.791638 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efaace45-7d83-4ba9-b60f-ae1d33d7710e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:25.792724 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efaace45-7d83-4ba9-b60f-ae1d33d7710e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:25.793348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efaace45-7d83-4ba9-b60f-ae1d33d7710e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:26.052811 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-efaace45-7d83-4ba9-b60f-ae1d33d7710e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:26.070493 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-efaace45-7d83-4ba9-b60f-ae1d33d7710e tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1502 microversion: 2.1 time: 0.288191 May 16 15:17:26.070493 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 136/276] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:25 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1502 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:26.070493 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2623c33d-b98a-4590-ae2f-04fd5455c346 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:26.070777 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2623c33d-b98a-4590-ae2f-04fd5455c346 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:26.077485 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2623c33d-b98a-4590-ae2f-04fd5455c346 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:26.078344 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2623c33d-b98a-4590-ae2f-04fd5455c346 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:26.079136 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2623c33d-b98a-4590-ae2f-04fd5455c346 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:26.079569 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2623c33d-b98a-4590-ae2f-04fd5455c346 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:26.241702 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2623c33d-b98a-4590-ae2f-04fd5455c346 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:26.256563 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2623c33d-b98a-4590-ae2f-04fd5455c346 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1510 microversion: 2.1 time: 0.190792 May 16 15:17:26.259407 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 137/277] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:26 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:26.968272 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ecdacab5-2bff-434a-bf74-2a8d8a017772 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Action: 'create', calling method: .version_select at 0x7fc9a7eb8ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1203983110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB71SswtdxM820R4UaOJspAEXHy/MKhPG12NowgwtiWsPem8yFFqyW+kK/KcYIe+bRT5axp4O68hRdtX4KgN3l12Szi4c3OPD1iIfB5o1KIE33hTY7M2WBT6a8HjdyfEw=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:26.998869 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-ecdacab5-2bff-434a-bf74-2a8d8a017772 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Getting quotas for project 18afd7d9815342c196be824d2b99d537. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:17:27.005781 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-ecdacab5-2bff-434a-bf74-2a8d8a017772 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Getting quotas for user 064ef0ac470b458ba5a675364f9cab31 and project 18afd7d9815342c196be824d2b99d537. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:17:27.079914 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] validate_networks() for [('982c6e92-7848-46dd-811d-5ec569a6da67', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:17:27.104242 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ecdacab5-2bff-434a-bf74-2a8d8a017772 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.147267 May 16 15:17:27.105545 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 138/278] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 16 15:17:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:17:27.113523 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7658cba7-c34a-4e68-8265-562be2174318 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:27.114542 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7658cba7-c34a-4e68-8265-562be2174318 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:27.125591 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7658cba7-c34a-4e68-8265-562be2174318 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.135207 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7658cba7-c34a-4e68-8265-562be2174318 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.135207 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7658cba7-c34a-4e68-8265-562be2174318 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.135207 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7658cba7-c34a-4e68-8265-562be2174318 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.317772 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7658cba7-c34a-4e68-8265-562be2174318 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:27.327168 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7658cba7-c34a-4e68-8265-562be2174318 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1502 microversion: 2.1 time: 0.218883 May 16 15:17:27.327741 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 139/279] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:27 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:27.333341 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1388363659", "imageRef": "4379d445-f406-4bac-8490-ca8c1d3aab5b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1203983110", "networks": [{"uuid": "0c4f9146-d1fd-486f-849d-27c0f1f9f510"}]}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:27.387653 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] validate_networks() for [('0c4f9146-d1fd-486f-849d-27c0f1f9f510', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:17:27.562512 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:17:27.563042 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:17:27.563620 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:17:27.564849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:17:27.565332 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:17:27.579373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.579932 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.580993 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.581541 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.601221 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for project d143bc5a616249a7beefc7b27962026b. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:17:27.605359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for user 44ffd5660baa40a7a3d6918cb5d31e56 and project d143bc5a616249a7beefc7b27962026b. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:17:27.616469 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:17:27.618948 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:17:27.732139 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a707ca54-9358-451e-9827-cef8334c120c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.897063 May 16 15:17:27.738144 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 141/280] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:17:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 3904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:17:27.743343 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f3d1a801-188d-4c3b-9104-2fd440939a69 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:27.744294 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f3d1a801-188d-4c3b-9104-2fd440939a69 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:27.751968 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3d1a801-188d-4c3b-9104-2fd440939a69 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.752753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3d1a801-188d-4c3b-9104-2fd440939a69 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.753842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3d1a801-188d-4c3b-9104-2fd440939a69 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.754581 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3d1a801-188d-4c3b-9104-2fd440939a69 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.787147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:17:27.787567 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:17:27.788149 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:17:27.788674 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:17:27.789085 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:17:27.799000 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.799463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.800276 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:27.800712 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:27.820133 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Getting quotas for project 18afd7d9815342c196be824d2b99d537. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:17:27.825450 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Getting quotas for user 064ef0ac470b458ba5a675364f9cab31 and project 18afd7d9815342c196be824d2b99d537. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:17:27.838399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:17:27.841276 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4379d445-f406-4bac-8490-ca8c1d3aab5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:17:27.915168 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f3d1a801-188d-4c3b-9104-2fd440939a69 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:27.923645 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f3d1a801-188d-4c3b-9104-2fd440939a69 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1516 microversion: 2.1 time: 0.184181 May 16 15:17:27.924214 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 142/281] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:27 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:27.937623 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e1e11add-cde6-4f66-a6fd-3d1d352bd991 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:27.938344 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e1e11add-cde6-4f66-a6fd-3d1d352bd991 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:27.982100 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ef074025-d9b9-4b57-98b8-d6444217f896 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652075 May 16 15:17:27.983115 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 140/282] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:17:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:17:27.994275 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fdb9c845-ee19-4cac-affe-69a957b83a51 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:27.994275 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fdb9c845-ee19-4cac-affe-69a957b83a51 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:28.045623 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e1e11add-cde6-4f66-a6fd-3d1d352bd991 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:28.072592 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e1e11add-cde6-4f66-a6fd-3d1d352bd991 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1240 microversion: 2.1 time: 0.144597 May 16 15:17:28.074768 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 143/283] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:27 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1240 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:28.083838 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fdb9c845-ee19-4cac-affe-69a957b83a51 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:28.093777 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fdb9c845-ee19-4cac-affe-69a957b83a51 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1259 microversion: 2.1 time: 0.102967 May 16 15:17:28.093777 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 141/284] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:27 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1259 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:28.344979 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-996d6e1f-f2d1-43dd-9e5b-2ed511a7bcb4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:28.345578 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-996d6e1f-f2d1-43dd-9e5b-2ed511a7bcb4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:28.352545 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-996d6e1f-f2d1-43dd-9e5b-2ed511a7bcb4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:28.353012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-996d6e1f-f2d1-43dd-9e5b-2ed511a7bcb4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:28.353778 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-996d6e1f-f2d1-43dd-9e5b-2ed511a7bcb4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:28.354250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-996d6e1f-f2d1-43dd-9e5b-2ed511a7bcb4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:28.534038 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-996d6e1f-f2d1-43dd-9e5b-2ed511a7bcb4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:28.543075 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-996d6e1f-f2d1-43dd-9e5b-2ed511a7bcb4 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1502 microversion: 2.1 time: 0.201867 May 16 15:17:28.543849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 144/285] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:28 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:28.933420 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-faef6270-5e8b-4d4a-9836-6abdddad71e0 req-32660ec6-a99f-47e3-85f7-c8d6ff307ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79fde843-2868-4a1f-a344-df85fd7b1e70", "name": "network-vif-deleted", "tag": "55dcbab2-a484-491c-8320-1c3a8ba319b8"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:28.952734 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-faef6270-5e8b-4d4a-9836-6abdddad71e0 req-32660ec6-a99f-47e3-85f7-c8d6ff307ed4 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:28.952734 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-faef6270-5e8b-4d4a-9836-6abdddad71e0 req-32660ec6-a99f-47e3-85f7-c8d6ff307ed4 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:28.962707 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-faef6270-5e8b-4d4a-9836-6abdddad71e0 req-32660ec6-a99f-47e3-85f7-c8d6ff307ed4 service nova] Creating event network-vif-deleted:55dcbab2-a484-491c-8320-1c3a8ba319b8 for instance 79fde843-2868-4a1f-a344-df85fd7b1e70 on hv-cinder-79578 May 16 15:17:28.968134 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-faef6270-5e8b-4d4a-9836-6abdddad71e0 req-32660ec6-a99f-47e3-85f7-c8d6ff307ed4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038577 May 16 15:17:28.968811 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 142/286] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:29.097627 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b79814d3-ea70-43b2-bf1c-b250b2264e1d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:29.098576 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b79814d3-ea70-43b2-bf1c-b250b2264e1d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:29.108790 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b79814d3-ea70-43b2-bf1c-b250b2264e1d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.109555 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b79814d3-ea70-43b2-bf1c-b250b2264e1d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.110370 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b79814d3-ea70-43b2-bf1c-b250b2264e1d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.110483 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-753ad1d7-c7bd-4b85-b662-bb91283caec7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:29.110943 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b79814d3-ea70-43b2-bf1c-b250b2264e1d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.111165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-753ad1d7-c7bd-4b85-b662-bb91283caec7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:29.193516 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-753ad1d7-c7bd-4b85-b662-bb91283caec7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:29.196755 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b79814d3-ea70-43b2-bf1c-b250b2264e1d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:29.200988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-753ad1d7-c7bd-4b85-b662-bb91283caec7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1259 microversion: 2.1 time: 0.095256 May 16 15:17:29.208981 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 143/287] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:29 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1259 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:29.209075 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b79814d3-ea70-43b2-bf1c-b250b2264e1d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1244 microversion: 2.1 time: 0.116311 May 16 15:17:29.209075 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 145/288] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:29 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1244 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:29.560583 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-baf3a54d-9852-400c-8b01-22cbd4a38e1f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:29.561179 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-baf3a54d-9852-400c-8b01-22cbd4a38e1f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:29.568236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-baf3a54d-9852-400c-8b01-22cbd4a38e1f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.568670 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-baf3a54d-9852-400c-8b01-22cbd4a38e1f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.569544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-baf3a54d-9852-400c-8b01-22cbd4a38e1f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.569971 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-baf3a54d-9852-400c-8b01-22cbd4a38e1f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.586739 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2d4c4269-e3bf-4b1f-98f0-63582f6a3481 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:29.596344 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2d4c4269-e3bf-4b1f-98f0-63582f6a3481 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.597150 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2d4c4269-e3bf-4b1f-98f0-63582f6a3481 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.603238 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-baf3a54d-9852-400c-8b01-22cbd4a38e1f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.603870 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-baf3a54d-9852-400c-8b01-22cbd4a38e1f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.604362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-baf3a54d-9852-400c-8b01-22cbd4a38e1f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lazy-loading 'fault' on Instance uuid 79fde843-2868-4a1f-a344-df85fd7b1e70 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:17:29.666142 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-baf3a54d-9852-400c-8b01-22cbd4a38e1f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665ea1968aff4e949cdf07c210e78067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c186c3409f94fa5bb7452eee4021eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:29.675604 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-baf3a54d-9852-400c-8b01-22cbd4a38e1f tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 200 len: 1303 microversion: 2.1 time: 0.119009 May 16 15:17:29.676728 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 144/289] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:29 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:29.691625 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2d4c4269-e3bf-4b1f-98f0-63582f6a3481 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Going to try to stop instance {{(pid=117648) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 15:17:29.784768 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a3152d7c-b5cf-435f-ba5f-f9889ad746c3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Action: 'create', calling method: .version_select at 0x7fc9a7eb83a0>, body: {"keypair": {"name": "tempest-keypair-198345449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBKFKZkYPjcpesccEmBBHRBemJAyyilEKL6ogbm+NBvEyZKo4I+0Nc/CVfeuLny6Uq548AwjR/ldAflF+KJHaK3x2yfZIa0uAY9Rw+mX9MZYXxD921flmBpXDKh5kIQ9A=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:29.800698 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-a3152d7c-b5cf-435f-ba5f-f9889ad746c3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Getting quotas for project 316917d7a31645bfaac651f81154c18f. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:17:29.804889 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-a3152d7c-b5cf-435f-ba5f-f9889ad746c3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Getting quotas for user a14795cb97ac44b2a7fc1e2f79b12253 and project 316917d7a31645bfaac651f81154c18f. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:17:29.872505 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2d4c4269-e3bf-4b1f-98f0-63582f6a3481 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "POST /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/action" status: 202 len: 0 microversion: 2.1 time: 0.289810 May 16 15:17:29.877225 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 146/290] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:17:29 2022] POST /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:17:29.881362 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d485a52b-a62a-497f-a510-9fa3956e47cb tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:29.882047 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d485a52b-a62a-497f-a510-9fa3956e47cb tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:29.889065 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d485a52b-a62a-497f-a510-9fa3956e47cb tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.889516 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d485a52b-a62a-497f-a510-9fa3956e47cb tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.890318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d485a52b-a62a-497f-a510-9fa3956e47cb tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:29.890755 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d485a52b-a62a-497f-a510-9fa3956e47cb tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:29.928524 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a3152d7c-b5cf-435f-ba5f-f9889ad746c3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.148814 May 16 15:17:29.929643 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 145/291] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 16 15:17:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:17:30.030550 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d485a52b-a62a-497f-a510-9fa3956e47cb tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:30.039849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d485a52b-a62a-497f-a510-9fa3956e47cb tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.162484 May 16 15:17:30.041878 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 147/292] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:29 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:30.220644 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2514a5f9-b619-400a-8d04-59d7a1616d13 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:30.221175 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2514a5f9-b619-400a-8d04-59d7a1616d13 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:30.222639 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-179685f2-278e-4aa9-bcec-f3f2e43f3ea6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:30.224783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-179685f2-278e-4aa9-bcec-f3f2e43f3ea6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:30.227637 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2514a5f9-b619-400a-8d04-59d7a1616d13 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.228121 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2514a5f9-b619-400a-8d04-59d7a1616d13 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:30.234283 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2514a5f9-b619-400a-8d04-59d7a1616d13 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.234283 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2514a5f9-b619-400a-8d04-59d7a1616d13 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:30.234551 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-179685f2-278e-4aa9-bcec-f3f2e43f3ea6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.234551 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-179685f2-278e-4aa9-bcec-f3f2e43f3ea6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:30.235900 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-179685f2-278e-4aa9-bcec-f3f2e43f3ea6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.236503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-179685f2-278e-4aa9-bcec-f3f2e43f3ea6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:30.324562 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-179685f2-278e-4aa9-bcec-f3f2e43f3ea6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:30.332169 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-179685f2-278e-4aa9-bcec-f3f2e43f3ea6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1292 microversion: 2.1 time: 0.113390 May 16 15:17:30.337286 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 148/293] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:30 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1292 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:30.377625 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2514a5f9-b619-400a-8d04-59d7a1616d13 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:30.384895 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2514a5f9-b619-400a-8d04-59d7a1616d13 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1255 microversion: 2.1 time: 0.168907 May 16 15:17:30.386399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 146/294] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:30 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1255 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:30.693702 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9fbf0e8a-8d2d-4ec6-985a-d575195a1e79 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:30.694633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9fbf0e8a-8d2d-4ec6-985a-d575195a1e79 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] [instance: 79fde843-2868-4a1f-a344-df85fd7b1e70] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:30.701621 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fbf0e8a-8d2d-4ec6-985a-d575195a1e79 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.702318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fbf0e8a-8d2d-4ec6-985a-d575195a1e79 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:30.708509 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fbf0e8a-8d2d-4ec6-985a-d575195a1e79 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:30.709040 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fbf0e8a-8d2d-4ec6-985a-d575195a1e79 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:30.728672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-9fbf0e8a-8d2d-4ec6-985a-d575195a1e79 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] HTTP exception thrown: Instance 79fde843-2868-4a1f-a344-df85fd7b1e70 could not be found. May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9fbf0e8a-8d2d-4ec6-985a-d575195a1e79 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Request method failure captured: May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 HTTP/1.1 May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmrMis6qR3iVvik1TGioLEAN5Z8jOFvK2H4Ti6lKutjKJOnIBfCNPzBRAojTCYsVYY-aomRnNxQ1kuN44EZUN0X4PpjOtCYcTSTVm8eQykVC7UVaHKvZhAT3OHShX_I2A8YU6XhiiXBgZkkg-emZgQjMVwpWEU-gmC6WxtGZgfVmwjI May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: 7c186c3409f94fa5bb7452eee4021eea May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesActionsTest-246403111 May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:17:30.730753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7c186c3409f94fa5bb7452eee4021eea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7c186c3409f94fa5bb7452eee4021eea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7c186c3409f94fa5bb7452eee4021eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7c186c3409f94fa5bb7452eee4021eea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesActionsTest-246403111 May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 7c186c3409f94fa5bb7452eee4021eea May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesActionsTest-246403111 May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesActionsTest-246403111-project May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 665ea1968aff4e949cdf07c210e78067 May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesActionsTest-246403111-project May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance 79fde843-2868-4a1f-a344-df85fd7b1e70 could not be found. May 16 15:17:30.732032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '79fde843-2868-4a1f-a344-df85fd7b1e70'} May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79fde843-2868-4a1f-a344-df85fd7b1e70 could not be found. May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:17:30.732754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79fde843-2868-4a1f-a344-df85fd7b1e70 could not be found. May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79fde843-2868-4a1f-a344-df85fd7b1e70 could not be found. May 16 15:17:30.734381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:17:30.736277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9fbf0e8a-8d2d-4ec6-985a-d575195a1e79 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] Returning 404 to user: Instance 79fde843-2868-4a1f-a344-df85fd7b1e70 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:17:30.736277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9fbf0e8a-8d2d-4ec6-985a-d575195a1e79 tempest-VolumesActionsTest-246403111 tempest-VolumesActionsTest-246403111-project] 10.222.0.44 "GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70" status: 404 len: 111 microversion: 2.1 time: 0.043268 May 16 15:17:30.736277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 149/295] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:30 2022] GET /compute/v2.1/servers/79fde843-2868-4a1f-a344-df85fd7b1e70 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:17:31.056882 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d534d593-17c3-46d5-9e09-590f8a45732d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:31.066368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d534d593-17c3-46d5-9e09-590f8a45732d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:31.066368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d534d593-17c3-46d5-9e09-590f8a45732d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:31.066368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d534d593-17c3-46d5-9e09-590f8a45732d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:31.066368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d534d593-17c3-46d5-9e09-590f8a45732d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:31.066684 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d534d593-17c3-46d5-9e09-590f8a45732d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:31.287245 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d534d593-17c3-46d5-9e09-590f8a45732d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:31.296534 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d534d593-17c3-46d5-9e09-590f8a45732d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.243675 May 16 15:17:31.297094 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 147/296] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:31 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:31.348724 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ff1443b6-e7b2-4c56-b29d-66b413800258 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:31.349341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ff1443b6-e7b2-4c56-b29d-66b413800258 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:31.361643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff1443b6-e7b2-4c56-b29d-66b413800258 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:31.362417 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff1443b6-e7b2-4c56-b29d-66b413800258 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:31.363557 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff1443b6-e7b2-4c56-b29d-66b413800258 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:31.365879 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff1443b6-e7b2-4c56-b29d-66b413800258 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:31.404537 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dbe840ae-fcbe-466d-a951-eeff8655325b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:31.405353 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dbe840ae-fcbe-466d-a951-eeff8655325b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:31.417768 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbe840ae-fcbe-466d-a951-eeff8655325b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:31.418608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbe840ae-fcbe-466d-a951-eeff8655325b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:31.420510 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbe840ae-fcbe-466d-a951-eeff8655325b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:31.421155 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbe840ae-fcbe-466d-a951-eeff8655325b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:31.493605 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ff1443b6-e7b2-4c56-b29d-66b413800258 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:31.502479 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ff1443b6-e7b2-4c56-b29d-66b413800258 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1298 microversion: 2.1 time: 0.157127 May 16 15:17:31.512828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 150/297] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:31 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1298 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:31.530346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dbe840ae-fcbe-466d-a951-eeff8655325b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:31.539703 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dbe840ae-fcbe-466d-a951-eeff8655325b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1311 microversion: 2.1 time: 0.140154 May 16 15:17:31.540604 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 148/298] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:31 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:32.315396 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-57bf3196-5768-4580-8f8e-f015be6ed5fa tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:32.316771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-57bf3196-5768-4580-8f8e-f015be6ed5fa tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:32.324513 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57bf3196-5768-4580-8f8e-f015be6ed5fa tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:32.325190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57bf3196-5768-4580-8f8e-f015be6ed5fa tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:32.326245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57bf3196-5768-4580-8f8e-f015be6ed5fa tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:32.326881 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57bf3196-5768-4580-8f8e-f015be6ed5fa tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:32.519761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e8b43645-9d00-4b3a-9be1-4cc224aaf85b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:32.520371 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e8b43645-9d00-4b3a-9be1-4cc224aaf85b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:32.530992 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8b43645-9d00-4b3a-9be1-4cc224aaf85b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:32.531443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8b43645-9d00-4b3a-9be1-4cc224aaf85b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:32.532225 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8b43645-9d00-4b3a-9be1-4cc224aaf85b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:32.532640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8b43645-9d00-4b3a-9be1-4cc224aaf85b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:32.548331 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-57bf3196-5768-4580-8f8e-f015be6ed5fa tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:32.558839 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-57bf3196-5768-4580-8f8e-f015be6ed5fa tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.248151 May 16 15:17:32.564218 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 151/299] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:32 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:32.566118 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5ca02e28-a7d5-4788-b97d-3629f90a32e3 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:32.566888 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5ca02e28-a7d5-4788-b97d-3629f90a32e3 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:32.583131 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5ca02e28-a7d5-4788-b97d-3629f90a32e3 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:32.583583 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5ca02e28-a7d5-4788-b97d-3629f90a32e3 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:32.584361 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5ca02e28-a7d5-4788-b97d-3629f90a32e3 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:32.584796 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5ca02e28-a7d5-4788-b97d-3629f90a32e3 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:32.667305 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5ca02e28-a7d5-4788-b97d-3629f90a32e3 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:32.674989 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5ca02e28-a7d5-4788-b97d-3629f90a32e3 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1317 microversion: 2.1 time: 0.112731 May 16 15:17:32.684852 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 152/300] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:32 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1317 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:32.854742 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e8b43645-9d00-4b3a-9be1-4cc224aaf85b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:32.865609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e8b43645-9d00-4b3a-9be1-4cc224aaf85b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.349620 May 16 15:17:32.872353 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 149/301] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:32 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:33.186431 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-fe329412-bfd9-4816-94ea-96a159d121b9 req-6f502883-459f-492e-a325-fb7eafd8b05a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4a1a85a-fe23-4b81-a511-c153411ecfab", "tag": "d2cefc0a-b410-472a-ae99-63766e348766"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:33.196296 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-fe329412-bfd9-4816-94ea-96a159d121b9 req-6f502883-459f-492e-a325-fb7eafd8b05a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.196743 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-fe329412-bfd9-4816-94ea-96a159d121b9 req-6f502883-459f-492e-a325-fb7eafd8b05a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.212399 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-fe329412-bfd9-4816-94ea-96a159d121b9 req-6f502883-459f-492e-a325-fb7eafd8b05a service nova] Creating event network-changed:d2cefc0a-b410-472a-ae99-63766e348766 for instance e4a1a85a-fe23-4b81-a511-c153411ecfab on hv-cinder-79578 May 16 15:17:33.224900 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-fe329412-bfd9-4816-94ea-96a159d121b9 req-6f502883-459f-492e-a325-fb7eafd8b05a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041984 May 16 15:17:33.229734 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 153/302] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:33.331838 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2003007967", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8561ad64-1b6b-4f33-82d1-a2d7e72d5b01"}], "security_groups": [{"name": "tempest-securitygroup--1811623306"}], "key_name": "tempest-keypair-198345449", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:33.448099 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] validate_networks() for [('8561ad64-1b6b-4f33-82d1-a2d7e72d5b01', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:17:33.580701 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3ac2c13e-f014-40a7-9184-2119efde191f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:33.581396 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3ac2c13e-f014-40a7-9184-2119efde191f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:33.587605 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ac2c13e-f014-40a7-9184-2119efde191f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.588066 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ac2c13e-f014-40a7-9184-2119efde191f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.589419 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ac2c13e-f014-40a7-9184-2119efde191f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.589854 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ac2c13e-f014-40a7-9184-2119efde191f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.720388 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3ac2c13e-f014-40a7-9184-2119efde191f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:33.728069 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3ac2c13e-f014-40a7-9184-2119efde191f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.152005 May 16 15:17:33.728636 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 154/303] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:33 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:33.732953 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-003b634b-c6ae-4cdb-b2f1-301d53c326b6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:33.733909 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-003b634b-c6ae-4cdb-b2f1-301d53c326b6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:33.739625 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-003b634b-c6ae-4cdb-b2f1-301d53c326b6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.740071 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-003b634b-c6ae-4cdb-b2f1-301d53c326b6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.740823 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-003b634b-c6ae-4cdb-b2f1-301d53c326b6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.741252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-003b634b-c6ae-4cdb-b2f1-301d53c326b6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.814978 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:17:33.815465 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:17:33.815871 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:17:33.816267 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:17:33.816669 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:17:33.826775 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.827305 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.828169 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.828810 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.849562 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Getting quotas for project 316917d7a31645bfaac651f81154c18f. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:17:33.853550 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Getting quotas for user a14795cb97ac44b2a7fc1e2f79b12253 and project 316917d7a31645bfaac651f81154c18f. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:17:33.865879 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:17:33.868230 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:17:33.869437 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-003b634b-c6ae-4cdb-b2f1-301d53c326b6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:33.877181 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-003b634b-c6ae-4cdb-b2f1-301d53c326b6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.147615 May 16 15:17:33.877739 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 155/304] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:33 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:33.888471 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d029cbe5-085a-4068-8dde-e6fa363059d0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:33.889075 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d029cbe5-085a-4068-8dde-e6fa363059d0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:33.899959 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d029cbe5-085a-4068-8dde-e6fa363059d0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.899959 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d029cbe5-085a-4068-8dde-e6fa363059d0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:33.899959 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d029cbe5-085a-4068-8dde-e6fa363059d0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:33.899959 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d029cbe5-085a-4068-8dde-e6fa363059d0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:34.004941 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-98e41cc0-7078-4a58-a5d0-1ab7214e8441 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.677619 May 16 15:17:34.005596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 150/305] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:17:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:17:34.019024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bfc82130-8944-4569-8dab-a716c7b9705a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:34.019708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bfc82130-8944-4569-8dab-a716c7b9705a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:34.038370 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d029cbe5-085a-4068-8dde-e6fa363059d0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:34.046325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d029cbe5-085a-4068-8dde-e6fa363059d0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.162016 May 16 15:17:34.047105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 156/306] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:33 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:34.077599 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bfc82130-8944-4569-8dab-a716c7b9705a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:34.084973 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bfc82130-8944-4569-8dab-a716c7b9705a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1245 microversion: 2.1 time: 0.069778 May 16 15:17:34.085680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 151/307] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:34 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:34.745415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-88fadbed-3a8b-4888-a73e-b6653178fa03 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:34.746035 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-88fadbed-3a8b-4888-a73e-b6653178fa03 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:34.752490 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88fadbed-3a8b-4888-a73e-b6653178fa03 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:34.752951 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88fadbed-3a8b-4888-a73e-b6653178fa03 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:34.753725 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88fadbed-3a8b-4888-a73e-b6653178fa03 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:34.754188 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88fadbed-3a8b-4888-a73e-b6653178fa03 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:34.880718 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88fadbed-3a8b-4888-a73e-b6653178fa03 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:34.889569 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-88fadbed-3a8b-4888-a73e-b6653178fa03 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.148620 May 16 15:17:34.890434 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 157/308] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:34 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:34.893350 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c6d9a9b3-1a7f-4395-9145-c380a5e7b75c tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:34.894387 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c6d9a9b3-1a7f-4395-9145-c380a5e7b75c tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:34.900786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6d9a9b3-1a7f-4395-9145-c380a5e7b75c tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:34.901231 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6d9a9b3-1a7f-4395-9145-c380a5e7b75c tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:34.901995 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6d9a9b3-1a7f-4395-9145-c380a5e7b75c tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:34.902449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6d9a9b3-1a7f-4395-9145-c380a5e7b75c tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:35.028638 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c6d9a9b3-1a7f-4395-9145-c380a5e7b75c tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:35.035815 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c6d9a9b3-1a7f-4395-9145-c380a5e7b75c tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.146266 May 16 15:17:35.036374 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 152/309] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:34 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:35.063639 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8b638c7a-2f3c-4fa7-adc4-544cf308e658 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:35.064366 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8b638c7a-2f3c-4fa7-adc4-544cf308e658 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:35.070522 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8b638c7a-2f3c-4fa7-adc4-544cf308e658 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:35.070971 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8b638c7a-2f3c-4fa7-adc4-544cf308e658 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:35.071736 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8b638c7a-2f3c-4fa7-adc4-544cf308e658 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:35.072275 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8b638c7a-2f3c-4fa7-adc4-544cf308e658 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:35.101795 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ec396124-22f4-41e2-b013-2d565823f95f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:35.102440 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ec396124-22f4-41e2-b013-2d565823f95f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:35.109684 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec396124-22f4-41e2-b013-2d565823f95f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:35.110151 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec396124-22f4-41e2-b013-2d565823f95f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:35.110921 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec396124-22f4-41e2-b013-2d565823f95f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:35.111356 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec396124-22f4-41e2-b013-2d565823f95f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:35.177297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ec396124-22f4-41e2-b013-2d565823f95f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:35.185812 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ec396124-22f4-41e2-b013-2d565823f95f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1249 microversion: 2.1 time: 0.087675 May 16 15:17:35.193271 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 153/310] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:35 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:35.208967 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8b638c7a-2f3c-4fa7-adc4-544cf308e658 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:35.216530 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8b638c7a-2f3c-4fa7-adc4-544cf308e658 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.156548 May 16 15:17:35.217102 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 158/311] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:35 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:35.920946 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-59f1e35d-0c3a-476e-a38a-f1dc40fbf8a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:35.924745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-59f1e35d-0c3a-476e-a38a-f1dc40fbf8a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:35.944218 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59f1e35d-0c3a-476e-a38a-f1dc40fbf8a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:35.944218 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59f1e35d-0c3a-476e-a38a-f1dc40fbf8a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:35.944218 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59f1e35d-0c3a-476e-a38a-f1dc40fbf8a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:35.944218 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59f1e35d-0c3a-476e-a38a-f1dc40fbf8a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:36.053881 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d6bb3c6a-4e3e-4cb4-b8e5-2e7304e3b89e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:36.055138 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d6bb3c6a-4e3e-4cb4-b8e5-2e7304e3b89e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:36.078879 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d6bb3c6a-4e3e-4cb4-b8e5-2e7304e3b89e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:36.078879 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d6bb3c6a-4e3e-4cb4-b8e5-2e7304e3b89e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:36.078879 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d6bb3c6a-4e3e-4cb4-b8e5-2e7304e3b89e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:36.078879 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d6bb3c6a-4e3e-4cb4-b8e5-2e7304e3b89e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:36.259308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-59f1e35d-0c3a-476e-a38a-f1dc40fbf8a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:36.267636 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d6bb3c6a-4e3e-4cb4-b8e5-2e7304e3b89e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:36.267855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-59f1e35d-0c3a-476e-a38a-f1dc40fbf8a2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.360308 May 16 15:17:36.268428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 154/312] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:35 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:36.272913 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b44dd923-7de2-4799-81e0-6efa0fb85174 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:36.273518 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b44dd923-7de2-4799-81e0-6efa0fb85174 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:36.279657 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b44dd923-7de2-4799-81e0-6efa0fb85174 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:36.280106 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b44dd923-7de2-4799-81e0-6efa0fb85174 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:36.280881 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b44dd923-7de2-4799-81e0-6efa0fb85174 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:36.281345 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b44dd923-7de2-4799-81e0-6efa0fb85174 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:36.283624 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d6bb3c6a-4e3e-4cb4-b8e5-2e7304e3b89e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.234895 May 16 15:17:36.285016 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 159/313] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:36 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:36.289468 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-10448228-74d8-4b5c-9bcc-5cb54c7a7f3c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:36.290081 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-10448228-74d8-4b5c-9bcc-5cb54c7a7f3c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:36.296545 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10448228-74d8-4b5c-9bcc-5cb54c7a7f3c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:36.297054 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10448228-74d8-4b5c-9bcc-5cb54c7a7f3c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:36.297828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10448228-74d8-4b5c-9bcc-5cb54c7a7f3c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:36.298292 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10448228-74d8-4b5c-9bcc-5cb54c7a7f3c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:36.355327 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b44dd923-7de2-4799-81e0-6efa0fb85174 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:36.364146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b44dd923-7de2-4799-81e0-6efa0fb85174 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1297 microversion: 2.1 time: 0.094717 May 16 15:17:36.365113 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 155/314] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:36 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:36.438829 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-10448228-74d8-4b5c-9bcc-5cb54c7a7f3c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:36.447498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-10448228-74d8-4b5c-9bcc-5cb54c7a7f3c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.162287 May 16 15:17:36.458023 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 160/315] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:36 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:36.680491 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-7a589f2f-2d75-497a-8c62-a4270a926c44 req-af200d3f-c4d2-4afa-9111-986818220da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2587084-89a0-47a8-909d-019d48b12e5c", "tag": "3904bae9-9274-4a0f-8757-bdbf49cf6aff"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:36.687149 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-7a589f2f-2d75-497a-8c62-a4270a926c44 req-af200d3f-c4d2-4afa-9111-986818220da7 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:36.687722 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-7a589f2f-2d75-497a-8c62-a4270a926c44 req-af200d3f-c4d2-4afa-9111-986818220da7 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:36.701279 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-7a589f2f-2d75-497a-8c62-a4270a926c44 req-af200d3f-c4d2-4afa-9111-986818220da7 service nova] Creating event network-changed:3904bae9-9274-4a0f-8757-bdbf49cf6aff for instance f2587084-89a0-47a8-909d-019d48b12e5c on hv-cinder-79578 May 16 15:17:36.706442 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-7a589f2f-2d75-497a-8c62-a4270a926c44 req-af200d3f-c4d2-4afa-9111-986818220da7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032924 May 16 15:17:36.707034 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 156/316] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:17:37.285181 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c1effed7-4e2b-4e5c-b50c-2ab300717175 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:37.285799 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c1effed7-4e2b-4e5c-b50c-2ab300717175 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:37.292115 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1effed7-4e2b-4e5c-b50c-2ab300717175 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:37.292580 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1effed7-4e2b-4e5c-b50c-2ab300717175 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:37.293335 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1effed7-4e2b-4e5c-b50c-2ab300717175 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:37.293769 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1effed7-4e2b-4e5c-b50c-2ab300717175 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:37.300510 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-33360873-8f61-4c12-a7e7-fbcbdcd29275 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:37.301191 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-33360873-8f61-4c12-a7e7-fbcbdcd29275 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:37.307763 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33360873-8f61-4c12-a7e7-fbcbdcd29275 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:37.308227 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33360873-8f61-4c12-a7e7-fbcbdcd29275 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:37.309024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33360873-8f61-4c12-a7e7-fbcbdcd29275 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:37.309458 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33360873-8f61-4c12-a7e7-fbcbdcd29275 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:37.426263 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c1effed7-4e2b-4e5c-b50c-2ab300717175 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:37.434003 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c1effed7-4e2b-4e5c-b50c-2ab300717175 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.152641 May 16 15:17:37.434596 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 161/317] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:37 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:37.437725 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-33360873-8f61-4c12-a7e7-fbcbdcd29275 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:37.439502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-24e75464-a30b-4a2c-8651-0f3e349aa4dd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:37.440440 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-24e75464-a30b-4a2c-8651-0f3e349aa4dd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:37.446532 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-33360873-8f61-4c12-a7e7-fbcbdcd29275 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.150129 May 16 15:17:37.447153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24e75464-a30b-4a2c-8651-0f3e349aa4dd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:37.447296 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 157/318] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:37 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:37.448045 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24e75464-a30b-4a2c-8651-0f3e349aa4dd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:37.449472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24e75464-a30b-4a2c-8651-0f3e349aa4dd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:37.449906 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24e75464-a30b-4a2c-8651-0f3e349aa4dd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:37.464815 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-340166a9-bf1a-4c55-84c0-2af57e7ded75 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:37.465429 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-340166a9-bf1a-4c55-84c0-2af57e7ded75 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:37.471197 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-340166a9-bf1a-4c55-84c0-2af57e7ded75 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:37.471642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-340166a9-bf1a-4c55-84c0-2af57e7ded75 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:37.472406 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-340166a9-bf1a-4c55-84c0-2af57e7ded75 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:37.472835 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-340166a9-bf1a-4c55-84c0-2af57e7ded75 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:37.509383 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-24e75464-a30b-4a2c-8651-0f3e349aa4dd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:37.517486 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-24e75464-a30b-4a2c-8651-0f3e349aa4dd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1297 microversion: 2.1 time: 0.081479 May 16 15:17:37.518076 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 162/319] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:37 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:37.602429 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-340166a9-bf1a-4c55-84c0-2af57e7ded75 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:37.609600 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-340166a9-bf1a-4c55-84c0-2af57e7ded75 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.148981 May 16 15:17:37.610182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 158/320] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:37 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:38.451365 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-09cc3791-4c25-44ed-8d8b-925954c9bc89 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:38.451906 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-09cc3791-4c25-44ed-8d8b-925954c9bc89 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:38.458260 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09cc3791-4c25-44ed-8d8b-925954c9bc89 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:38.458736 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09cc3791-4c25-44ed-8d8b-925954c9bc89 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:38.459505 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09cc3791-4c25-44ed-8d8b-925954c9bc89 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:38.459937 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09cc3791-4c25-44ed-8d8b-925954c9bc89 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:38.463518 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9087251e-1cbc-43ee-b49e-b1d369635c5f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:38.464616 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9087251e-1cbc-43ee-b49e-b1d369635c5f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:38.470775 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9087251e-1cbc-43ee-b49e-b1d369635c5f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:38.471217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9087251e-1cbc-43ee-b49e-b1d369635c5f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:38.471971 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9087251e-1cbc-43ee-b49e-b1d369635c5f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:38.472395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9087251e-1cbc-43ee-b49e-b1d369635c5f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:38.586213 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-09cc3791-4c25-44ed-8d8b-925954c9bc89 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:38.594434 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-09cc3791-4c25-44ed-8d8b-925954c9bc89 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.147025 May 16 15:17:38.595005 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 163/321] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:38 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:38.596551 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9087251e-1cbc-43ee-b49e-b1d369635c5f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:38.599341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2af1f482-c05e-4f15-a941-2b7eab0ecaba tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:38.599942 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2af1f482-c05e-4f15-a941-2b7eab0ecaba tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:38.604155 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9087251e-1cbc-43ee-b49e-b1d369635c5f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.144370 May 16 15:17:38.605360 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 159/322] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:38 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:38.606316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2af1f482-c05e-4f15-a941-2b7eab0ecaba tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:38.606766 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2af1f482-c05e-4f15-a941-2b7eab0ecaba tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:38.607525 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2af1f482-c05e-4f15-a941-2b7eab0ecaba tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:38.607953 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2af1f482-c05e-4f15-a941-2b7eab0ecaba tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:38.625972 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f1f1959f-21fe-48e9-9889-fa146329994c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:38.626679 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f1f1959f-21fe-48e9-9889-fa146329994c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:38.632436 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1f1959f-21fe-48e9-9889-fa146329994c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:38.632882 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1f1959f-21fe-48e9-9889-fa146329994c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:38.633644 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1f1959f-21fe-48e9-9889-fa146329994c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:38.634093 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1f1959f-21fe-48e9-9889-fa146329994c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:38.670993 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2af1f482-c05e-4f15-a941-2b7eab0ecaba tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:38.679177 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2af1f482-c05e-4f15-a941-2b7eab0ecaba tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1297 microversion: 2.1 time: 0.083103 May 16 15:17:38.680407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 164/323] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:38 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:38.774236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f1f1959f-21fe-48e9-9889-fa146329994c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:38.782689 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f1f1959f-21fe-48e9-9889-fa146329994c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.160434 May 16 15:17:38.783264 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 160/324] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:38 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:39.612668 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5651a598-4928-4750-8b3b-3cfdb83f24c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:39.613342 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5651a598-4928-4750-8b3b-3cfdb83f24c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:39.620209 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5651a598-4928-4750-8b3b-3cfdb83f24c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:39.621350 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-72651dab-1a4b-415b-8492-50c22f8c232a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:39.621968 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-72651dab-1a4b-415b-8492-50c22f8c232a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:39.622430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5651a598-4928-4750-8b3b-3cfdb83f24c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:39.623417 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5651a598-4928-4750-8b3b-3cfdb83f24c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:39.624059 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5651a598-4928-4750-8b3b-3cfdb83f24c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:39.632604 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-72651dab-1a4b-415b-8492-50c22f8c232a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:39.633610 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-72651dab-1a4b-415b-8492-50c22f8c232a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:39.644789 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-72651dab-1a4b-415b-8492-50c22f8c232a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:39.645335 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-72651dab-1a4b-415b-8492-50c22f8c232a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:39.774991 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5651a598-4928-4750-8b3b-3cfdb83f24c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:39.783139 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5651a598-4928-4750-8b3b-3cfdb83f24c4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.174917 May 16 15:17:39.793419 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 165/325] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:39 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:39.798500 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cb308b87-61ba-49ff-950e-46e86ab3f5d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:39.799104 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cb308b87-61ba-49ff-950e-46e86ab3f5d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:39.803231 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-72651dab-1a4b-415b-8492-50c22f8c232a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:39.804901 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cb308b87-61ba-49ff-950e-46e86ab3f5d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:39.805348 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cb308b87-61ba-49ff-950e-46e86ab3f5d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:39.806146 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cb308b87-61ba-49ff-950e-46e86ab3f5d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:39.806584 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cb308b87-61ba-49ff-950e-46e86ab3f5d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:39.811246 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-72651dab-1a4b-415b-8492-50c22f8c232a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.194453 May 16 15:17:39.811813 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 161/326] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:39 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:39.816162 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b97d8323-c61f-46c6-b8e8-0cf2ecf9306d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:39.817023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b97d8323-c61f-46c6-b8e8-0cf2ecf9306d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:39.822596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b97d8323-c61f-46c6-b8e8-0cf2ecf9306d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:39.823039 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b97d8323-c61f-46c6-b8e8-0cf2ecf9306d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:39.823869 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b97d8323-c61f-46c6-b8e8-0cf2ecf9306d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:39.824309 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b97d8323-c61f-46c6-b8e8-0cf2ecf9306d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:39.881100 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cb308b87-61ba-49ff-950e-46e86ab3f5d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:39.889371 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cb308b87-61ba-49ff-950e-46e86ab3f5d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1297 microversion: 2.1 time: 0.094489 May 16 15:17:39.890148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 166/327] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:39 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:39.982807 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b97d8323-c61f-46c6-b8e8-0cf2ecf9306d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:39.989985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b97d8323-c61f-46c6-b8e8-0cf2ecf9306d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.177251 May 16 15:17:39.990614 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 162/328] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:39 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:40.803818 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2c82306f-13c6-46fa-8a45-817c0d0d7ed8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:40.804918 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2c82306f-13c6-46fa-8a45-817c0d0d7ed8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:40.820130 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2c82306f-13c6-46fa-8a45-817c0d0d7ed8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:40.820831 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2c82306f-13c6-46fa-8a45-817c0d0d7ed8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:40.821825 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2c82306f-13c6-46fa-8a45-817c0d0d7ed8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:40.830632 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fc8877ec-3a7b-402f-8626-36707f8c014d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:40.831276 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2c82306f-13c6-46fa-8a45-817c0d0d7ed8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:40.831457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fc8877ec-3a7b-402f-8626-36707f8c014d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:40.848827 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8877ec-3a7b-402f-8626-36707f8c014d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:40.849533 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8877ec-3a7b-402f-8626-36707f8c014d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:40.855855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8877ec-3a7b-402f-8626-36707f8c014d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:40.856714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8877ec-3a7b-402f-8626-36707f8c014d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:41.139472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2c82306f-13c6-46fa-8a45-817c0d0d7ed8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:41.151122 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2c82306f-13c6-46fa-8a45-817c0d0d7ed8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.352927 May 16 15:17:41.161082 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fc8877ec-3a7b-402f-8626-36707f8c014d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:41.165140 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 167/329] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:40 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:41.170003 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fc8877ec-3a7b-402f-8626-36707f8c014d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.343999 May 16 15:17:41.181566 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0e0866d2-ea2a-46ca-ae60-9e853e6d3f59 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:41.181566 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0e0866d2-ea2a-46ca-ae60-9e853e6d3f59 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:41.194984 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 163/330] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:40 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:41.195189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e0866d2-ea2a-46ca-ae60-9e853e6d3f59 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:41.195189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e0866d2-ea2a-46ca-ae60-9e853e6d3f59 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:41.195189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e0866d2-ea2a-46ca-ae60-9e853e6d3f59 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:41.195189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e0866d2-ea2a-46ca-ae60-9e853e6d3f59 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:41.197564 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-10b5b69f-7960-4ace-b0b6-412f57dd30bd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:41.198477 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-10b5b69f-7960-4ace-b0b6-412f57dd30bd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:41.211851 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10b5b69f-7960-4ace-b0b6-412f57dd30bd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:41.212306 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10b5b69f-7960-4ace-b0b6-412f57dd30bd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:41.213110 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10b5b69f-7960-4ace-b0b6-412f57dd30bd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:41.213548 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10b5b69f-7960-4ace-b0b6-412f57dd30bd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:41.270360 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0e0866d2-ea2a-46ca-ae60-9e853e6d3f59 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:41.297443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0e0866d2-ea2a-46ca-ae60-9e853e6d3f59 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1297 microversion: 2.1 time: 0.111935 May 16 15:17:41.299890 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 168/331] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:41 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1297 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:41.444913 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-10b5b69f-7960-4ace-b0b6-412f57dd30bd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:41.463538 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-10b5b69f-7960-4ace-b0b6-412f57dd30bd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.285655 May 16 15:17:41.466185 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 164/332] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:41 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:42.173967 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9d744f3b-2b4b-4b2c-821d-d894ed1f773b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:42.175749 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9d744f3b-2b4b-4b2c-821d-d894ed1f773b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:42.184367 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9d744f3b-2b4b-4b2c-821d-d894ed1f773b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:42.185547 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9d744f3b-2b4b-4b2c-821d-d894ed1f773b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:42.186654 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9d744f3b-2b4b-4b2c-821d-d894ed1f773b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:42.187282 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9d744f3b-2b4b-4b2c-821d-d894ed1f773b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:42.196619 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4384cc1d-6f05-42a3-a641-194c48ecefb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:42.198127 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4384cc1d-6f05-42a3-a641-194c48ecefb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:42.221292 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4384cc1d-6f05-42a3-a641-194c48ecefb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:42.223353 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4384cc1d-6f05-42a3-a641-194c48ecefb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:42.224460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4384cc1d-6f05-42a3-a641-194c48ecefb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:42.225062 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4384cc1d-6f05-42a3-a641-194c48ecefb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:42.640945 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4384cc1d-6f05-42a3-a641-194c48ecefb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:42.652709 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4384cc1d-6f05-42a3-a641-194c48ecefb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.466009 May 16 15:17:42.654151 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 165/333] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:42 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:42.666472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9d744f3b-2b4b-4b2c-821d-d894ed1f773b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:42.681681 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9d744f3b-2b4b-4b2c-821d-d894ed1f773b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.512343 May 16 15:17:42.684646 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2a5e4a77-6b8c-4521-9f1b-ce7dad77e8df tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:42.695713 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 169/334] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:42 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:42.695973 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2a5e4a77-6b8c-4521-9f1b-ce7dad77e8df tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:42.701465 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2887d1ae-0f86-42ba-a684-15159e208817 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:42.703922 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2887d1ae-0f86-42ba-a684-15159e208817 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:42.706598 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a5e4a77-6b8c-4521-9f1b-ce7dad77e8df tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:42.707187 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a5e4a77-6b8c-4521-9f1b-ce7dad77e8df tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:42.708198 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a5e4a77-6b8c-4521-9f1b-ce7dad77e8df tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:42.711439 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a5e4a77-6b8c-4521-9f1b-ce7dad77e8df tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:42.719640 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2887d1ae-0f86-42ba-a684-15159e208817 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:42.720398 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2887d1ae-0f86-42ba-a684-15159e208817 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:42.725191 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2887d1ae-0f86-42ba-a684-15159e208817 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:42.726671 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2887d1ae-0f86-42ba-a684-15159e208817 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:42.843759 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2a5e4a77-6b8c-4521-9f1b-ce7dad77e8df tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:42.853026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2a5e4a77-6b8c-4521-9f1b-ce7dad77e8df tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1297 microversion: 2.1 time: 0.197537 May 16 15:17:42.864009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 166/335] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:42 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1297 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:43.290833 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2887d1ae-0f86-42ba-a684-15159e208817 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:43.304801 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2887d1ae-0f86-42ba-a684-15159e208817 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.616771 May 16 15:17:43.306095 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 170/336] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:42 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:43.685460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1383885f-99c7-49e1-bcb8-c4a6fca13850 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:43.697126 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1383885f-99c7-49e1-bcb8-c4a6fca13850 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:43.721013 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-81716ac1-65e3-4dff-af46-4340a522faf0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:43.722154 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-81716ac1-65e3-4dff-af46-4340a522faf0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:43.730709 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1383885f-99c7-49e1-bcb8-c4a6fca13850 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:43.732731 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-81716ac1-65e3-4dff-af46-4340a522faf0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:43.734425 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-81716ac1-65e3-4dff-af46-4340a522faf0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:43.738626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-81716ac1-65e3-4dff-af46-4340a522faf0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:43.739430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-81716ac1-65e3-4dff-af46-4340a522faf0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:43.745783 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1383885f-99c7-49e1-bcb8-c4a6fca13850 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:43.763416 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1383885f-99c7-49e1-bcb8-c4a6fca13850 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:43.763791 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1383885f-99c7-49e1-bcb8-c4a6fca13850 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:44.129814 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-81716ac1-65e3-4dff-af46-4340a522faf0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:44.172653 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-81716ac1-65e3-4dff-af46-4340a522faf0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.453667 May 16 15:17:44.184935 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 171/337] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:43 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:44.210829 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1383885f-99c7-49e1-bcb8-c4a6fca13850 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:44.212270 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-528bddf8-7457-470c-a11a-da46ee25c054 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:44.217225 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-528bddf8-7457-470c-a11a-da46ee25c054 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:44.219554 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1383885f-99c7-49e1-bcb8-c4a6fca13850 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.549136 May 16 15:17:44.220904 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 167/338] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:43 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:44.302453 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-528bddf8-7457-470c-a11a-da46ee25c054 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:44.302453 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-528bddf8-7457-470c-a11a-da46ee25c054 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:44.302453 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-528bddf8-7457-470c-a11a-da46ee25c054 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:44.302453 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-528bddf8-7457-470c-a11a-da46ee25c054 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:44.323491 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e71988bc-4eab-4774-9a55-d4daf8b4fc74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:44.324110 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e71988bc-4eab-4774-9a55-d4daf8b4fc74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:44.337808 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e71988bc-4eab-4774-9a55-d4daf8b4fc74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:44.342619 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e71988bc-4eab-4774-9a55-d4daf8b4fc74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:44.343744 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e71988bc-4eab-4774-9a55-d4daf8b4fc74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:44.344385 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e71988bc-4eab-4774-9a55-d4daf8b4fc74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:44.392704 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-528bddf8-7457-470c-a11a-da46ee25c054 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:44.392704 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-528bddf8-7457-470c-a11a-da46ee25c054 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1297 microversion: 2.1 time: 0.178776 May 16 15:17:44.392704 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 172/339] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:44 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1297 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:44.563596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e71988bc-4eab-4774-9a55-d4daf8b4fc74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:44.571325 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e71988bc-4eab-4774-9a55-d4daf8b4fc74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.251977 May 16 15:17:44.571976 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 168/340] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:44 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:45.191301 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-49233f8e-160d-4a1b-b7b7-d7f8b137c6a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:45.192172 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-49233f8e-160d-4a1b-b7b7-d7f8b137c6a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:45.202954 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-49233f8e-160d-4a1b-b7b7-d7f8b137c6a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.203413 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-49233f8e-160d-4a1b-b7b7-d7f8b137c6a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:45.204590 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-49233f8e-160d-4a1b-b7b7-d7f8b137c6a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.205203 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-49233f8e-160d-4a1b-b7b7-d7f8b137c6a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:45.241776 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9937ab39-c08d-48c7-befa-8904d397794b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:45.243065 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9937ab39-c08d-48c7-befa-8904d397794b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:45.259120 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9937ab39-c08d-48c7-befa-8904d397794b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.266493 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9937ab39-c08d-48c7-befa-8904d397794b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:45.267848 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9937ab39-c08d-48c7-befa-8904d397794b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.269310 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9937ab39-c08d-48c7-befa-8904d397794b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:45.463289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-49233f8e-160d-4a1b-b7b7-d7f8b137c6a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:45.475499 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-49233f8e-160d-4a1b-b7b7-d7f8b137c6a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.287525 May 16 15:17:45.490023 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 173/341] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:45 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:45.498495 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d9e308fb-4794-494d-8adc-933ff6438bec tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:45.507930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d9e308fb-4794-494d-8adc-933ff6438bec tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:45.507930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9e308fb-4794-494d-8adc-933ff6438bec tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.507930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9e308fb-4794-494d-8adc-933ff6438bec tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:45.508474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9e308fb-4794-494d-8adc-933ff6438bec tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.509529 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9e308fb-4794-494d-8adc-933ff6438bec tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:45.597271 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9937ab39-c08d-48c7-befa-8904d397794b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:45.615738 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9937ab39-c08d-48c7-befa-8904d397794b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.381846 May 16 15:17:45.622273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d9e308fb-4794-494d-8adc-933ff6438bec tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:45.625091 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 169/342] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:45 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:45.635994 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d9e308fb-4794-494d-8adc-933ff6438bec tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1297 microversion: 2.1 time: 0.143623 May 16 15:17:45.636948 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 174/343] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:45 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1297 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:45.641496 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b93a0708-09d0-43fa-9e2b-72ecce8928af tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:45.642419 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b93a0708-09d0-43fa-9e2b-72ecce8928af tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:45.648866 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b93a0708-09d0-43fa-9e2b-72ecce8928af tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.649543 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b93a0708-09d0-43fa-9e2b-72ecce8928af tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:45.650534 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b93a0708-09d0-43fa-9e2b-72ecce8928af tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:45.652076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b93a0708-09d0-43fa-9e2b-72ecce8928af tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:46.027639 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b93a0708-09d0-43fa-9e2b-72ecce8928af tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:46.039097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b93a0708-09d0-43fa-9e2b-72ecce8928af tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.412033 May 16 15:17:46.043395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 170/344] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:45 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:46.494914 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e0be1215-748d-4078-8d53-0f68455035bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:46.496458 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e0be1215-748d-4078-8d53-0f68455035bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:46.508418 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0be1215-748d-4078-8d53-0f68455035bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:46.509257 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0be1215-748d-4078-8d53-0f68455035bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:46.510873 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0be1215-748d-4078-8d53-0f68455035bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:46.514652 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0be1215-748d-4078-8d53-0f68455035bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:46.637230 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4abfa140-77f0-4517-9403-68b9f00c6c8a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:46.637854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4abfa140-77f0-4517-9403-68b9f00c6c8a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:46.655172 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4abfa140-77f0-4517-9403-68b9f00c6c8a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:46.656076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4abfa140-77f0-4517-9403-68b9f00c6c8a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:46.657499 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4abfa140-77f0-4517-9403-68b9f00c6c8a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:46.658476 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4abfa140-77f0-4517-9403-68b9f00c6c8a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:47.147889 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e0be1215-748d-4078-8d53-0f68455035bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:47.157918 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e0be1215-748d-4078-8d53-0f68455035bc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.667086 May 16 15:17:47.162491 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 175/345] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:46 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:47.181543 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-44af40ba-509f-4a86-9b2b-3e3fd70dad9a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:47.182741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-44af40ba-509f-4a86-9b2b-3e3fd70dad9a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:47.196568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44af40ba-509f-4a86-9b2b-3e3fd70dad9a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:47.200239 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44af40ba-509f-4a86-9b2b-3e3fd70dad9a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:47.202933 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44af40ba-509f-4a86-9b2b-3e3fd70dad9a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:47.212373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44af40ba-509f-4a86-9b2b-3e3fd70dad9a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:47.275120 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4abfa140-77f0-4517-9403-68b9f00c6c8a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:47.287633 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4abfa140-77f0-4517-9403-68b9f00c6c8a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.654788 May 16 15:17:47.299131 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 171/346] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:46 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:47.314336 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-69fd19b3-fe91-4f48-aa20-ef2bc0fea57f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:47.315796 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-69fd19b3-fe91-4f48-aa20-ef2bc0fea57f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:47.335185 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-69fd19b3-fe91-4f48-aa20-ef2bc0fea57f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:47.336753 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-69fd19b3-fe91-4f48-aa20-ef2bc0fea57f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:47.339382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-69fd19b3-fe91-4f48-aa20-ef2bc0fea57f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:47.340136 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-69fd19b3-fe91-4f48-aa20-ef2bc0fea57f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:47.412344 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-44af40ba-509f-4a86-9b2b-3e3fd70dad9a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:47.420728 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-44af40ba-509f-4a86-9b2b-3e3fd70dad9a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1303 microversion: 2.1 time: 0.258816 May 16 15:17:47.425139 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 176/347] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:47 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1303 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:48.074391 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-69fd19b3-fe91-4f48-aa20-ef2bc0fea57f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:48.083681 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-69fd19b3-fe91-4f48-aa20-ef2bc0fea57f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.783161 May 16 15:17:48.089222 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 172/348] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:47 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:48.178331 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-96aec278-4784-43a4-9e9b-5b59c716fb37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:48.179882 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-96aec278-4784-43a4-9e9b-5b59c716fb37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:48.199322 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96aec278-4784-43a4-9e9b-5b59c716fb37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:48.200150 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96aec278-4784-43a4-9e9b-5b59c716fb37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:48.201541 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96aec278-4784-43a4-9e9b-5b59c716fb37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:48.202228 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96aec278-4784-43a4-9e9b-5b59c716fb37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:48.309758 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2dee6b11-bc27-45db-92c9-b25af7ca46fc tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:48.310553 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2dee6b11-bc27-45db-92c9-b25af7ca46fc tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:48.323665 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dee6b11-bc27-45db-92c9-b25af7ca46fc tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:48.324636 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dee6b11-bc27-45db-92c9-b25af7ca46fc tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:48.325544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dee6b11-bc27-45db-92c9-b25af7ca46fc tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:48.326097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dee6b11-bc27-45db-92c9-b25af7ca46fc tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:48.635878 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-96aec278-4784-43a4-9e9b-5b59c716fb37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:48.635878 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-96aec278-4784-43a4-9e9b-5b59c716fb37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.438683 May 16 15:17:48.635878 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 177/349] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:48 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:48.635878 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-04de7642-4bb0-42de-91b0-c999defedb24 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:48.636420 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-04de7642-4bb0-42de-91b0-c999defedb24 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:48.636420 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-04de7642-4bb0-42de-91b0-c999defedb24 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:48.636420 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-04de7642-4bb0-42de-91b0-c999defedb24 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:48.636420 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-04de7642-4bb0-42de-91b0-c999defedb24 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:48.636894 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-04de7642-4bb0-42de-91b0-c999defedb24 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:48.645097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2dee6b11-bc27-45db-92c9-b25af7ca46fc tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:48.691960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2dee6b11-bc27-45db-92c9-b25af7ca46fc tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.386457 May 16 15:17:48.698207 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 173/350] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:48 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:48.773478 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-04de7642-4bb0-42de-91b0-c999defedb24 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:48.780998 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-04de7642-4bb0-42de-91b0-c999defedb24 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.164870 May 16 15:17:48.786416 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 178/351] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:48 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:49.113700 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f4540873-5180-44fd-8cea-fc7e56b79e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:49.116568 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f4540873-5180-44fd-8cea-fc7e56b79e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:49.129267 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f4540873-5180-44fd-8cea-fc7e56b79e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:49.130233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f4540873-5180-44fd-8cea-fc7e56b79e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:49.131253 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f4540873-5180-44fd-8cea-fc7e56b79e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:49.132796 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f4540873-5180-44fd-8cea-fc7e56b79e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:49.409679 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f4540873-5180-44fd-8cea-fc7e56b79e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:49.420742 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f4540873-5180-44fd-8cea-fc7e56b79e74 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.317685 May 16 15:17:49.422385 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 174/352] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:49 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:49.652498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ded9bfff-b311-4fc8-b6a2-43537937fdbc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:49.653945 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ded9bfff-b311-4fc8-b6a2-43537937fdbc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:49.662634 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ded9bfff-b311-4fc8-b6a2-43537937fdbc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:49.663407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ded9bfff-b311-4fc8-b6a2-43537937fdbc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:49.664430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ded9bfff-b311-4fc8-b6a2-43537937fdbc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:49.665018 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ded9bfff-b311-4fc8-b6a2-43537937fdbc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:49.708995 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3f9532f5-cccb-47d0-bda7-991da8baf513 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:49.709895 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3f9532f5-cccb-47d0-bda7-991da8baf513 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:49.723289 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f9532f5-cccb-47d0-bda7-991da8baf513 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:49.724168 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f9532f5-cccb-47d0-bda7-991da8baf513 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:49.725114 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f9532f5-cccb-47d0-bda7-991da8baf513 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:49.730912 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f9532f5-cccb-47d0-bda7-991da8baf513 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:49.996615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3f9532f5-cccb-47d0-bda7-991da8baf513 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:49.998380 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ded9bfff-b311-4fc8-b6a2-43537937fdbc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:50.017896 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3f9532f5-cccb-47d0-bda7-991da8baf513 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.312855 May 16 15:17:50.023966 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ded9bfff-b311-4fc8-b6a2-43537937fdbc tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1722 microversion: 2.1 time: 0.376841 May 16 15:17:50.024849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 179/353] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:49 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1722 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:50.034963 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 175/354] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:49 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:50.036176 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-20866fc3-8f7e-42f0-87f2-b8a03cb18460 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:50.039194 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-20866fc3-8f7e-42f0-87f2-b8a03cb18460 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:50.049894 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20866fc3-8f7e-42f0-87f2-b8a03cb18460 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:50.050387 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20866fc3-8f7e-42f0-87f2-b8a03cb18460 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:50.055389 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20866fc3-8f7e-42f0-87f2-b8a03cb18460 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:50.056030 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20866fc3-8f7e-42f0-87f2-b8a03cb18460 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:50.365624 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-20866fc3-8f7e-42f0-87f2-b8a03cb18460 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:50.392621 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-20866fc3-8f7e-42f0-87f2-b8a03cb18460 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.364845 May 16 15:17:50.397536 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 180/355] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:50 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:50.445950 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4bb4da86-886a-4e3a-b17f-378a1d62fd30 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:50.447747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4bb4da86-886a-4e3a-b17f-378a1d62fd30 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:50.460038 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4bb4da86-886a-4e3a-b17f-378a1d62fd30 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:50.460762 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4bb4da86-886a-4e3a-b17f-378a1d62fd30 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:50.465268 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4bb4da86-886a-4e3a-b17f-378a1d62fd30 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:50.465268 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4bb4da86-886a-4e3a-b17f-378a1d62fd30 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:50.782420 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4bb4da86-886a-4e3a-b17f-378a1d62fd30 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:50.792472 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4bb4da86-886a-4e3a-b17f-378a1d62fd30 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.354526 May 16 15:17:50.797533 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 176/356] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:50 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:51.044695 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1f2d58fd-5549-4c6b-a105-ea2b3d02f65e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:51.045317 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1f2d58fd-5549-4c6b-a105-ea2b3d02f65e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:51.051034 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bbbff578-a699-4250-8125-864449126c6e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:51.051833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bbbff578-a699-4250-8125-864449126c6e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:51.060973 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f2d58fd-5549-4c6b-a105-ea2b3d02f65e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.061496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f2d58fd-5549-4c6b-a105-ea2b3d02f65e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.099398 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f2d58fd-5549-4c6b-a105-ea2b3d02f65e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.099398 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f2d58fd-5549-4c6b-a105-ea2b3d02f65e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.099577 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbbff578-a699-4250-8125-864449126c6e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.099577 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbbff578-a699-4250-8125-864449126c6e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.099577 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbbff578-a699-4250-8125-864449126c6e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.099577 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbbff578-a699-4250-8125-864449126c6e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.288003 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bbbff578-a699-4250-8125-864449126c6e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:51.301840 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bbbff578-a699-4250-8125-864449126c6e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.254494 May 16 15:17:51.312137 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 177/357] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:51 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:51.314271 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1f2d58fd-5549-4c6b-a105-ea2b3d02f65e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:51.325755 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1f2d58fd-5549-4c6b-a105-ea2b3d02f65e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1699 microversion: 2.1 time: 0.285499 May 16 15:17:51.327495 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 181/358] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:51 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1699 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:51.345147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f154bc9b-47dd-420b-9106-1e3201db323c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:51.352464 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f154bc9b-47dd-420b-9106-1e3201db323c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.352464 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f154bc9b-47dd-420b-9106-1e3201db323c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.417448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-43a2c1e5-7e4b-47a1-9bb3-4cb5c46462ae tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:51.417698 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-43a2c1e5-7e4b-47a1-9bb3-4cb5c46462ae tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:51.430984 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43a2c1e5-7e4b-47a1-9bb3-4cb5c46462ae tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.431433 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43a2c1e5-7e4b-47a1-9bb3-4cb5c46462ae tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.432250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43a2c1e5-7e4b-47a1-9bb3-4cb5c46462ae tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.438131 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43a2c1e5-7e4b-47a1-9bb3-4cb5c46462ae tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.480248 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f154bc9b-47dd-420b-9106-1e3201db323c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Going to try to start instance {{(pid=117649) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 15:17:51.667509 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f154bc9b-47dd-420b-9106-1e3201db323c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "POST /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/action" status: 202 len: 0 microversion: 2.1 time: 0.326687 May 16 15:17:51.673894 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 178/359] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:17:51 2022] POST /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:17:51.691799 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-109f2e5f-168d-4389-aa41-36d1b8b0eeb9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:51.696796 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-109f2e5f-168d-4389-aa41-36d1b8b0eeb9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:51.722324 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-109f2e5f-168d-4389-aa41-36d1b8b0eeb9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.722868 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-109f2e5f-168d-4389-aa41-36d1b8b0eeb9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.723855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-109f2e5f-168d-4389-aa41-36d1b8b0eeb9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.724357 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-109f2e5f-168d-4389-aa41-36d1b8b0eeb9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.804784 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-43a2c1e5-7e4b-47a1-9bb3-4cb5c46462ae tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:51.813451 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-43a2c1e5-7e4b-47a1-9bb3-4cb5c46462ae tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.402616 May 16 15:17:51.824964 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 182/360] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:51 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:51.829879 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3ad2abf4-4014-4b57-a3e9-c48a8ab194df tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:51.830553 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3ad2abf4-4014-4b57-a3e9-c48a8ab194df tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:51.838006 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ad2abf4-4014-4b57-a3e9-c48a8ab194df tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.838504 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ad2abf4-4014-4b57-a3e9-c48a8ab194df tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.839452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ad2abf4-4014-4b57-a3e9-c48a8ab194df tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:51.839908 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ad2abf4-4014-4b57-a3e9-c48a8ab194df tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:51.893191 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-109f2e5f-168d-4389-aa41-36d1b8b0eeb9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:51.901644 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-109f2e5f-168d-4389-aa41-36d1b8b0eeb9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1708 microversion: 2.1 time: 0.223913 May 16 15:17:51.913531 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 179/361] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:51 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1708 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:51.995890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-5f86ec9c-f029-4c46-85dd-7d03ee54864f req-452948b6-5887-4bc6-95ff-64e800027e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f78dee55-4357-4bb4-8057-ddecdd7326f6", "tag": "0a775fd5-0c4b-4d34-8fea-0665c23c121b"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:52.011942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-5f86ec9c-f029-4c46-85dd-7d03ee54864f req-452948b6-5887-4bc6-95ff-64e800027e32 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:52.017229 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-5f86ec9c-f029-4c46-85dd-7d03ee54864f req-452948b6-5887-4bc6-95ff-64e800027e32 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:52.034538 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-5f86ec9c-f029-4c46-85dd-7d03ee54864f req-452948b6-5887-4bc6-95ff-64e800027e32 service nova] Creating event network-changed:0a775fd5-0c4b-4d34-8fea-0665c23c121b for instance f78dee55-4357-4bb4-8057-ddecdd7326f6 on hv-cinder-79578 May 16 15:17:52.040395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-5f86ec9c-f029-4c46-85dd-7d03ee54864f req-452948b6-5887-4bc6-95ff-64e800027e32 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051562 May 16 15:17:52.043260 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 180/362] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:17:52.132969 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3ad2abf4-4014-4b57-a3e9-c48a8ab194df tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:52.142026 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3ad2abf4-4014-4b57-a3e9-c48a8ab194df tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.315892 May 16 15:17:52.142634 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 183/363] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:51 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:52.320493 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6dc962d0-f79d-455a-bd6c-eec78d9ebac2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:52.321174 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6dc962d0-f79d-455a-bd6c-eec78d9ebac2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:52.327946 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6dc962d0-f79d-455a-bd6c-eec78d9ebac2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:52.328312 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6dc962d0-f79d-455a-bd6c-eec78d9ebac2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:52.329064 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6dc962d0-f79d-455a-bd6c-eec78d9ebac2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:52.329491 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6dc962d0-f79d-455a-bd6c-eec78d9ebac2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:52.461887 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6dc962d0-f79d-455a-bd6c-eec78d9ebac2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:52.469152 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6dc962d0-f79d-455a-bd6c-eec78d9ebac2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.153131 May 16 15:17:52.469710 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 181/364] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:52 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:52.831046 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-10af798d-618f-4f98-b8f3-cc3e7d492a1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:52.831663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-10af798d-618f-4f98-b8f3-cc3e7d492a1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:52.837559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10af798d-618f-4f98-b8f3-cc3e7d492a1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:52.838542 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10af798d-618f-4f98-b8f3-cc3e7d492a1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:52.839315 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10af798d-618f-4f98-b8f3-cc3e7d492a1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:52.839754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10af798d-618f-4f98-b8f3-cc3e7d492a1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:52.920985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cae524fd-620e-4462-9a8b-6732b8e6bce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:52.921598 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cae524fd-620e-4462-9a8b-6732b8e6bce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:52.927980 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cae524fd-620e-4462-9a8b-6732b8e6bce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:52.928433 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cae524fd-620e-4462-9a8b-6732b8e6bce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:52.929204 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cae524fd-620e-4462-9a8b-6732b8e6bce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:52.929643 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cae524fd-620e-4462-9a8b-6732b8e6bce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:52.969770 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-10af798d-618f-4f98-b8f3-cc3e7d492a1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:52.976350 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-10af798d-618f-4f98-b8f3-cc3e7d492a1d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.149077 May 16 15:17:52.976927 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 184/365] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:52 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:53.061277 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cae524fd-620e-4462-9a8b-6732b8e6bce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:53.069342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cae524fd-620e-4462-9a8b-6732b8e6bce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1708 microversion: 2.1 time: 0.152042 May 16 15:17:53.069835 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 182/366] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:52 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:53.159206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-45a88cda-1eeb-42cd-9b9d-dfb017d74e0e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:53.159811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-45a88cda-1eeb-42cd-9b9d-dfb017d74e0e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:53.165830 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-45a88cda-1eeb-42cd-9b9d-dfb017d74e0e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:53.166302 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-45a88cda-1eeb-42cd-9b9d-dfb017d74e0e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:53.167071 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-45a88cda-1eeb-42cd-9b9d-dfb017d74e0e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:53.167509 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-45a88cda-1eeb-42cd-9b9d-dfb017d74e0e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:53.291578 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-45a88cda-1eeb-42cd-9b9d-dfb017d74e0e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:53.298680 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-45a88cda-1eeb-42cd-9b9d-dfb017d74e0e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.143333 May 16 15:17:53.299286 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 185/367] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:53 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:53.488793 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3e03005e-9834-4868-8950-9e8e70b6801d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:53.489327 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3e03005e-9834-4868-8950-9e8e70b6801d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:53.495864 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e03005e-9834-4868-8950-9e8e70b6801d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:53.496320 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e03005e-9834-4868-8950-9e8e70b6801d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:53.497082 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e03005e-9834-4868-8950-9e8e70b6801d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:53.497516 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e03005e-9834-4868-8950-9e8e70b6801d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:53.649649 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3e03005e-9834-4868-8950-9e8e70b6801d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:53.658266 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3e03005e-9834-4868-8950-9e8e70b6801d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.172514 May 16 15:17:53.659117 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 183/368] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:53 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:54.027536 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d41aac8e-f724-4e79-a817-da0158a4e889 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:54.028828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d41aac8e-f724-4e79-a817-da0158a4e889 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:54.036394 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d41aac8e-f724-4e79-a817-da0158a4e889 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.037036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d41aac8e-f724-4e79-a817-da0158a4e889 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.037920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d41aac8e-f724-4e79-a817-da0158a4e889 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.038462 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d41aac8e-f724-4e79-a817-da0158a4e889 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.087654 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aa178036-4556-4c27-bb64-02412a9b8796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:54.088796 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aa178036-4556-4c27-bb64-02412a9b8796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:54.095531 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa178036-4556-4c27-bb64-02412a9b8796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.096043 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa178036-4556-4c27-bb64-02412a9b8796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.096851 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa178036-4556-4c27-bb64-02412a9b8796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.097331 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa178036-4556-4c27-bb64-02412a9b8796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.200071 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d41aac8e-f724-4e79-a817-da0158a4e889 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:54.221831 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d41aac8e-f724-4e79-a817-da0158a4e889 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.232784 May 16 15:17:54.233612 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 186/369] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:53 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:54.252828 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aa178036-4556-4c27-bb64-02412a9b8796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:54.261725 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aa178036-4556-4c27-bb64-02412a9b8796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1708 microversion: 2.1 time: 0.177747 May 16 15:17:54.270206 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 184/370] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:54 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1708 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:54.319090 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8120b7de-7196-4eee-812f-2c29a50cf99d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:54.321223 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8120b7de-7196-4eee-812f-2c29a50cf99d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:54.331732 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8120b7de-7196-4eee-812f-2c29a50cf99d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.333815 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8120b7de-7196-4eee-812f-2c29a50cf99d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.333815 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8120b7de-7196-4eee-812f-2c29a50cf99d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.333815 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8120b7de-7196-4eee-812f-2c29a50cf99d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.526635 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8120b7de-7196-4eee-812f-2c29a50cf99d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:54.537918 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8120b7de-7196-4eee-812f-2c29a50cf99d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.223408 May 16 15:17:54.538474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 187/371] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:54 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:54.674920 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d8bd57f8-0f02-4b48-a93c-3aa003e981c9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:54.675934 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d8bd57f8-0f02-4b48-a93c-3aa003e981c9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:54.682183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8bd57f8-0f02-4b48-a93c-3aa003e981c9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.682856 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8bd57f8-0f02-4b48-a93c-3aa003e981c9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.683858 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8bd57f8-0f02-4b48-a93c-3aa003e981c9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:54.684450 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8bd57f8-0f02-4b48-a93c-3aa003e981c9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:54.851518 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d8bd57f8-0f02-4b48-a93c-3aa003e981c9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:54.861205 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d8bd57f8-0f02-4b48-a93c-3aa003e981c9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.189958 May 16 15:17:54.861912 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 185/372] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:54 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:55.239464 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-116f8dc2-1f96-4e8f-921a-3a81f32ad84b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:55.240101 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-116f8dc2-1f96-4e8f-921a-3a81f32ad84b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:55.248748 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-116f8dc2-1f96-4e8f-921a-3a81f32ad84b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:55.249567 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-116f8dc2-1f96-4e8f-921a-3a81f32ad84b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:55.250370 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-116f8dc2-1f96-4e8f-921a-3a81f32ad84b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:55.250802 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-116f8dc2-1f96-4e8f-921a-3a81f32ad84b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:55.285855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-af1a920a-5856-4ef1-b861-a1e370f6f2f8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:55.286655 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-af1a920a-5856-4ef1-b861-a1e370f6f2f8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:55.296112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af1a920a-5856-4ef1-b861-a1e370f6f2f8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:55.297803 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af1a920a-5856-4ef1-b861-a1e370f6f2f8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:55.298750 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af1a920a-5856-4ef1-b861-a1e370f6f2f8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:55.300408 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af1a920a-5856-4ef1-b861-a1e370f6f2f8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:55.488510 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-116f8dc2-1f96-4e8f-921a-3a81f32ad84b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:55.496851 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-116f8dc2-1f96-4e8f-921a-3a81f32ad84b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.261298 May 16 15:17:55.501746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 188/373] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:55 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:55.518759 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-af1a920a-5856-4ef1-b861-a1e370f6f2f8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:55.528469 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-af1a920a-5856-4ef1-b861-a1e370f6f2f8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1708 microversion: 2.1 time: 0.246531 May 16 15:17:55.551052 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 186/374] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:55 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1708 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:55.557135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6bee5a74-d3eb-40ae-9189-d136d1035402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:55.558027 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6bee5a74-d3eb-40ae-9189-d136d1035402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:55.565164 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6bee5a74-d3eb-40ae-9189-d136d1035402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:55.565880 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6bee5a74-d3eb-40ae-9189-d136d1035402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:55.567103 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6bee5a74-d3eb-40ae-9189-d136d1035402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:55.567731 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6bee5a74-d3eb-40ae-9189-d136d1035402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:55.643972 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-b14d952a-8e49-43f5-81f6-4d1563de967f req-85a97c75-6773-42a8-8ba1-774a5f6430a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a1a85a-fe23-4b81-a511-c153411ecfab", "name": "network-vif-plugged", "status": "completed", "tag": "d2cefc0a-b410-472a-ae99-63766e348766"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:17:55.654114 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-b14d952a-8e49-43f5-81f6-4d1563de967f req-85a97c75-6773-42a8-8ba1-774a5f6430a8 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:55.654708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-b14d952a-8e49-43f5-81f6-4d1563de967f req-85a97c75-6773-42a8-8ba1-774a5f6430a8 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:55.670030 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-b14d952a-8e49-43f5-81f6-4d1563de967f req-85a97c75-6773-42a8-8ba1-774a5f6430a8 service nova] Creating event network-vif-plugged:d2cefc0a-b410-472a-ae99-63766e348766 for instance e4a1a85a-fe23-4b81-a511-c153411ecfab on hv-cinder-79578 May 16 15:17:55.689797 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-b14d952a-8e49-43f5-81f6-4d1563de967f req-85a97c75-6773-42a8-8ba1-774a5f6430a8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052250 May 16 15:17:55.690928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 187/375] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:17:55.741005 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6bee5a74-d3eb-40ae-9189-d136d1035402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:55.771210 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6bee5a74-d3eb-40ae-9189-d136d1035402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.218316 May 16 15:17:55.783410 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 189/376] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:55 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:55.883135 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-447c1e3a-e922-4acd-b3f1-2f13f434680d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:55.884185 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-447c1e3a-e922-4acd-b3f1-2f13f434680d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:55.893754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-447c1e3a-e922-4acd-b3f1-2f13f434680d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:55.894382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-447c1e3a-e922-4acd-b3f1-2f13f434680d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:55.895283 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-447c1e3a-e922-4acd-b3f1-2f13f434680d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:55.895797 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-447c1e3a-e922-4acd-b3f1-2f13f434680d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:56.084797 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-447c1e3a-e922-4acd-b3f1-2f13f434680d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:56.094606 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-447c1e3a-e922-4acd-b3f1-2f13f434680d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.216454 May 16 15:17:56.095438 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 188/377] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:55 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:56.516033 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a18590d2-9c4c-4b67-a084-606e5b2edc56 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:56.517340 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a18590d2-9c4c-4b67-a084-606e5b2edc56 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:56.525564 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a18590d2-9c4c-4b67-a084-606e5b2edc56 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:56.526384 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a18590d2-9c4c-4b67-a084-606e5b2edc56 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:56.527486 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a18590d2-9c4c-4b67-a084-606e5b2edc56 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:56.528148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a18590d2-9c4c-4b67-a084-606e5b2edc56 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:56.547018 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c26e35b2-2cf1-4eb9-9a5b-b6f4eb9764a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:56.548207 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c26e35b2-2cf1-4eb9-9a5b-b6f4eb9764a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:56.557867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c26e35b2-2cf1-4eb9-9a5b-b6f4eb9764a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:56.560621 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c26e35b2-2cf1-4eb9-9a5b-b6f4eb9764a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:56.563678 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c26e35b2-2cf1-4eb9-9a5b-b6f4eb9764a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:56.564330 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c26e35b2-2cf1-4eb9-9a5b-b6f4eb9764a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:56.879655 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a18590d2-9c4c-4b67-a084-606e5b2edc56 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:56.894559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a18590d2-9c4c-4b67-a084-606e5b2edc56 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.382203 May 16 15:17:56.895339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 190/378] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:56 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:56.910810 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9fd79b5f-6c2c-4780-acbe-2ec32460ff11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:56.911691 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9fd79b5f-6c2c-4780-acbe-2ec32460ff11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:56.918895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fd79b5f-6c2c-4780-acbe-2ec32460ff11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:56.919591 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fd79b5f-6c2c-4780-acbe-2ec32460ff11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:56.920610 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fd79b5f-6c2c-4780-acbe-2ec32460ff11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:56.921199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fd79b5f-6c2c-4780-acbe-2ec32460ff11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:56.961384 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c26e35b2-2cf1-4eb9-9a5b-b6f4eb9764a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:56.973650 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c26e35b2-2cf1-4eb9-9a5b-b6f4eb9764a8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1708 microversion: 2.1 time: 0.430649 May 16 15:17:56.974568 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 189/379] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:56 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1708 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:57.111855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d2a19e5f-e9b9-4e63-8464-ad3c3e84145e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:57.112631 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d2a19e5f-e9b9-4e63-8464-ad3c3e84145e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:57.124166 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2a19e5f-e9b9-4e63-8464-ad3c3e84145e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:57.124612 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2a19e5f-e9b9-4e63-8464-ad3c3e84145e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:57.125389 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2a19e5f-e9b9-4e63-8464-ad3c3e84145e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:57.125817 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2a19e5f-e9b9-4e63-8464-ad3c3e84145e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:57.209754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9fd79b5f-6c2c-4780-acbe-2ec32460ff11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:57.218236 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9fd79b5f-6c2c-4780-acbe-2ec32460ff11 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.311126 May 16 15:17:57.219109 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 191/380] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:56 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:57.309829 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d2a19e5f-e9b9-4e63-8464-ad3c3e84145e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:57.320982 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d2a19e5f-e9b9-4e63-8464-ad3c3e84145e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.212830 May 16 15:17:57.327151 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 190/381] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:57 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:57.913029 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-199dfda4-ae0f-4766-b2cb-380400a586cc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:57.913715 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-199dfda4-ae0f-4766-b2cb-380400a586cc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:57.920672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-199dfda4-ae0f-4766-b2cb-380400a586cc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:57.921120 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-199dfda4-ae0f-4766-b2cb-380400a586cc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:57.921925 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-199dfda4-ae0f-4766-b2cb-380400a586cc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:57.922382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-199dfda4-ae0f-4766-b2cb-380400a586cc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:57.991431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-24e749b3-e444-4d7e-9dfb-920f01ae0c40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:57.992066 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-24e749b3-e444-4d7e-9dfb-920f01ae0c40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:57.998522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24e749b3-e444-4d7e-9dfb-920f01ae0c40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:57.998991 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24e749b3-e444-4d7e-9dfb-920f01ae0c40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:57.999940 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24e749b3-e444-4d7e-9dfb-920f01ae0c40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:58.000373 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24e749b3-e444-4d7e-9dfb-920f01ae0c40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:58.054261 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-199dfda4-ae0f-4766-b2cb-380400a586cc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:58.061658 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-199dfda4-ae0f-4766-b2cb-380400a586cc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.152848 May 16 15:17:58.062258 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 192/382] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:57 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:58.129706 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-24e749b3-e444-4d7e-9dfb-920f01ae0c40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:58.137834 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-24e749b3-e444-4d7e-9dfb-920f01ae0c40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1708 microversion: 2.1 time: 0.150368 May 16 15:17:58.138421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 191/383] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:57 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:58.240760 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6db10ee8-0682-4786-859f-a8bb5f02fb7a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:58.242785 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6db10ee8-0682-4786-859f-a8bb5f02fb7a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:58.252035 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6db10ee8-0682-4786-859f-a8bb5f02fb7a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:58.252487 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6db10ee8-0682-4786-859f-a8bb5f02fb7a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:58.260855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6db10ee8-0682-4786-859f-a8bb5f02fb7a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:58.261315 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6db10ee8-0682-4786-859f-a8bb5f02fb7a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:58.340402 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dcf83d3c-9a50-4676-aa91-83b575669f5a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:58.342385 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dcf83d3c-9a50-4676-aa91-83b575669f5a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:58.361070 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcf83d3c-9a50-4676-aa91-83b575669f5a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:58.366023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcf83d3c-9a50-4676-aa91-83b575669f5a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:58.367091 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcf83d3c-9a50-4676-aa91-83b575669f5a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:58.376438 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcf83d3c-9a50-4676-aa91-83b575669f5a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:58.512208 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6db10ee8-0682-4786-859f-a8bb5f02fb7a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:58.521705 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6db10ee8-0682-4786-859f-a8bb5f02fb7a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1365 microversion: 2.1 time: 0.288120 May 16 15:17:58.522519 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 193/384] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:58 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1365 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:59.039233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dcf83d3c-9a50-4676-aa91-83b575669f5a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:59.052981 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dcf83d3c-9a50-4676-aa91-83b575669f5a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.718267 May 16 15:17:59.056226 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 192/385] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:58 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:17:59.079564 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-33229d28-e412-4acf-a9e5-db479400fe6e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:59.083782 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-33229d28-e412-4acf-a9e5-db479400fe6e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:59.091690 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-33229d28-e412-4acf-a9e5-db479400fe6e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.092381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-33229d28-e412-4acf-a9e5-db479400fe6e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.093408 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-33229d28-e412-4acf-a9e5-db479400fe6e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.094124 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-33229d28-e412-4acf-a9e5-db479400fe6e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.156508 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-47636bc6-819b-4cec-bf5d-247a25a6132a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:59.157010 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-47636bc6-819b-4cec-bf5d-247a25a6132a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:59.163535 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47636bc6-819b-4cec-bf5d-247a25a6132a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.163980 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47636bc6-819b-4cec-bf5d-247a25a6132a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.164751 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47636bc6-819b-4cec-bf5d-247a25a6132a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.165182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47636bc6-819b-4cec-bf5d-247a25a6132a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.273534 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-33229d28-e412-4acf-a9e5-db479400fe6e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:59.286581 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-33229d28-e412-4acf-a9e5-db479400fe6e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.211039 May 16 15:17:59.289302 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 194/386] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:59 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:59.423631 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-47636bc6-819b-4cec-bf5d-247a25a6132a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:59.444608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-47636bc6-819b-4cec-bf5d-247a25a6132a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1708 microversion: 2.1 time: 0.292741 May 16 15:17:59.449512 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 193/387] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:59 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1708 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:59.541870 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c41a4ff2-657e-4862-a1be-9fd0d202f812 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:59.542883 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c41a4ff2-657e-4862-a1be-9fd0d202f812 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:59.555660 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c41a4ff2-657e-4862-a1be-9fd0d202f812 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.556240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c41a4ff2-657e-4862-a1be-9fd0d202f812 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.557087 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c41a4ff2-657e-4862-a1be-9fd0d202f812 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.557597 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c41a4ff2-657e-4862-a1be-9fd0d202f812 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.748443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c41a4ff2-657e-4862-a1be-9fd0d202f812 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:17:59.763464 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c41a4ff2-657e-4862-a1be-9fd0d202f812 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1555 microversion: 2.1 time: 0.227456 May 16 15:17:59.782433 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-501d10bb-4920-4066-b608-bf8ae831771c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:17:59.783215 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-501d10bb-4920-4066-b608-bf8ae831771c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:17:59.789956 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-501d10bb-4920-4066-b608-bf8ae831771c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.790258 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 195/388] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:17:59 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:17:59.790896 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-501d10bb-4920-4066-b608-bf8ae831771c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.792039 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-501d10bb-4920-4066-b608-bf8ae831771c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:17:59.792673 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-501d10bb-4920-4066-b608-bf8ae831771c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:17:59.934534 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-501d10bb-4920-4066-b608-bf8ae831771c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156205 May 16 15:17:59.935046 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 194/389] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 16 15:17:59 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:00.070069 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-48175e87-40be-44e6-bbcd-a7088041befb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:00.071062 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-48175e87-40be-44e6-bbcd-a7088041befb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:00.084526 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48175e87-40be-44e6-bbcd-a7088041befb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:00.085727 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48175e87-40be-44e6-bbcd-a7088041befb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:00.088019 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48175e87-40be-44e6-bbcd-a7088041befb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:00.090857 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48175e87-40be-44e6-bbcd-a7088041befb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:00.164587 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-9f78ae16-ed2b-4a6e-8cda-5d062cbd347a req-589f027e-0799-4018-a3b5-541e12abd5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2587084-89a0-47a8-909d-019d48b12e5c", "name": "network-vif-plugged", "status": "completed", "tag": "3904bae9-9274-4a0f-8757-bdbf49cf6aff"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:00.182116 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-9f78ae16-ed2b-4a6e-8cda-5d062cbd347a req-589f027e-0799-4018-a3b5-541e12abd5c7 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:00.183472 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-9f78ae16-ed2b-4a6e-8cda-5d062cbd347a req-589f027e-0799-4018-a3b5-541e12abd5c7 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:00.211794 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-9f78ae16-ed2b-4a6e-8cda-5d062cbd347a req-589f027e-0799-4018-a3b5-541e12abd5c7 service nova] Creating event network-vif-plugged:3904bae9-9274-4a0f-8757-bdbf49cf6aff for instance f2587084-89a0-47a8-909d-019d48b12e5c on hv-cinder-79578 May 16 15:18:00.220118 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-9f78ae16-ed2b-4a6e-8cda-5d062cbd347a req-589f027e-0799-4018-a3b5-541e12abd5c7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061751 May 16 15:18:00.230460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 195/390] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:18:00.309548 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ccbf9d41-cf2a-4ee4-bd81-7c8f66f45c94 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:00.310495 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ccbf9d41-cf2a-4ee4-bd81-7c8f66f45c94 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:00.331647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccbf9d41-cf2a-4ee4-bd81-7c8f66f45c94 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:00.334334 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccbf9d41-cf2a-4ee4-bd81-7c8f66f45c94 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:00.336018 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccbf9d41-cf2a-4ee4-bd81-7c8f66f45c94 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:00.341753 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccbf9d41-cf2a-4ee4-bd81-7c8f66f45c94 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:00.366748 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-48175e87-40be-44e6-bbcd-a7088041befb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:00.375823 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-48175e87-40be-44e6-bbcd-a7088041befb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.310072 May 16 15:18:00.377569 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 196/391] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:00 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:00.464670 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-78b68fcb-d968-46b7-a940-0e0e66e6f59d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:00.465639 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-78b68fcb-d968-46b7-a940-0e0e66e6f59d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:00.476233 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-78b68fcb-d968-46b7-a940-0e0e66e6f59d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:00.477020 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-78b68fcb-d968-46b7-a940-0e0e66e6f59d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:00.478691 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-78b68fcb-d968-46b7-a940-0e0e66e6f59d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:00.479888 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-78b68fcb-d968-46b7-a940-0e0e66e6f59d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:00.614836 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ccbf9d41-cf2a-4ee4-bd81-7c8f66f45c94 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:00.623460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ccbf9d41-cf2a-4ee4-bd81-7c8f66f45c94 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.319778 May 16 15:18:00.624250 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 196/392] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:00 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:00.789382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-78b68fcb-d968-46b7-a940-0e0e66e6f59d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:00.839583 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-78b68fcb-d968-46b7-a940-0e0e66e6f59d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1712 microversion: 2.1 time: 0.377033 May 16 15:18:00.842239 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 197/393] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:00 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1712 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:01.393223 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-03254830-d3c5-4462-99a0-80d7df3843bb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:01.397712 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-03254830-d3c5-4462-99a0-80d7df3843bb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:01.412745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03254830-d3c5-4462-99a0-80d7df3843bb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:01.413390 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03254830-d3c5-4462-99a0-80d7df3843bb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:01.414389 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03254830-d3c5-4462-99a0-80d7df3843bb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:01.414986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03254830-d3c5-4462-99a0-80d7df3843bb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:01.640968 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-74726967-dcae-4520-994e-7ee2ea1d3fbb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:01.641810 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-74726967-dcae-4520-994e-7ee2ea1d3fbb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:01.658851 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-74726967-dcae-4520-994e-7ee2ea1d3fbb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:01.659367 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-74726967-dcae-4520-994e-7ee2ea1d3fbb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:01.661329 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-74726967-dcae-4520-994e-7ee2ea1d3fbb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:01.661788 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-74726967-dcae-4520-994e-7ee2ea1d3fbb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:01.686284 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-03254830-d3c5-4462-99a0-80d7df3843bb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:01.695579 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-03254830-d3c5-4462-99a0-80d7df3843bb tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.306310 May 16 15:18:01.707998 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 197/394] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:01 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:01.940927 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-74726967-dcae-4520-994e-7ee2ea1d3fbb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:01.952580 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-74726967-dcae-4520-994e-7ee2ea1d3fbb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.314126 May 16 15:18:01.953849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 198/395] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:01 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:02.261843 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-404bd047-41c4-4aea-a1a9-75d558e0abf1 req-47396048-cf91-45e8-85e2-4734625c09f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4a1a85a-fe23-4b81-a511-c153411ecfab", "tag": "d2cefc0a-b410-472a-ae99-63766e348766"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:02.275631 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-404bd047-41c4-4aea-a1a9-75d558e0abf1 req-47396048-cf91-45e8-85e2-4734625c09f6 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:02.278616 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-404bd047-41c4-4aea-a1a9-75d558e0abf1 req-47396048-cf91-45e8-85e2-4734625c09f6 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:02.298734 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-404bd047-41c4-4aea-a1a9-75d558e0abf1 req-47396048-cf91-45e8-85e2-4734625c09f6 service nova] Creating event network-changed:d2cefc0a-b410-472a-ae99-63766e348766 for instance e4a1a85a-fe23-4b81-a511-c153411ecfab on hv-cinder-79578 May 16 15:18:02.304547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-404bd047-41c4-4aea-a1a9-75d558e0abf1 req-47396048-cf91-45e8-85e2-4734625c09f6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048003 May 16 15:18:02.306311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 198/396] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:02.727415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-997aa393-1d5e-4a37-9eb6-d3b53b360db7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:02.735281 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-997aa393-1d5e-4a37-9eb6-d3b53b360db7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:02.750789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-997aa393-1d5e-4a37-9eb6-d3b53b360db7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:02.750789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-997aa393-1d5e-4a37-9eb6-d3b53b360db7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:02.750789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-997aa393-1d5e-4a37-9eb6-d3b53b360db7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:02.750789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-997aa393-1d5e-4a37-9eb6-d3b53b360db7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:02.974311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-729c70ce-10e4-4f39-a4c8-9f0eff606711 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:02.974311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-729c70ce-10e4-4f39-a4c8-9f0eff606711 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:02.991671 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-729c70ce-10e4-4f39-a4c8-9f0eff606711 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:02.992666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-729c70ce-10e4-4f39-a4c8-9f0eff606711 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:02.997050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-729c70ce-10e4-4f39-a4c8-9f0eff606711 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:03.002718 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-729c70ce-10e4-4f39-a4c8-9f0eff606711 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:03.031596 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-997aa393-1d5e-4a37-9eb6-d3b53b360db7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:03.046379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-997aa393-1d5e-4a37-9eb6-d3b53b360db7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1359 microversion: 2.1 time: 0.325361 May 16 15:18:03.047061 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 199/397] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:02 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:03.197188 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-729c70ce-10e4-4f39-a4c8-9f0eff606711 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:03.204808 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-729c70ce-10e4-4f39-a4c8-9f0eff606711 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.238074 May 16 15:18:03.205431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 199/398] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:02 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:04.064479 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-69f91bad-6f6e-437e-aa35-85c07f276a34 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:04.065341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-69f91bad-6f6e-437e-aa35-85c07f276a34 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:04.072391 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69f91bad-6f6e-437e-aa35-85c07f276a34 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.073207 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69f91bad-6f6e-437e-aa35-85c07f276a34 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.074195 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69f91bad-6f6e-437e-aa35-85c07f276a34 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.074628 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69f91bad-6f6e-437e-aa35-85c07f276a34 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.147311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-704ca317-8905-4e8b-bdb2-cc981f5011bc req-a8710ac0-5fa6-4870-8091-3824da23f24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78dee55-4357-4bb4-8057-ddecdd7326f6", "name": "network-vif-plugged", "status": "completed", "tag": "0a775fd5-0c4b-4d34-8fea-0665c23c121b"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:04.156780 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-704ca317-8905-4e8b-bdb2-cc981f5011bc req-a8710ac0-5fa6-4870-8091-3824da23f24c service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.158477 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-704ca317-8905-4e8b-bdb2-cc981f5011bc req-a8710ac0-5fa6-4870-8091-3824da23f24c service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.172053 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-704ca317-8905-4e8b-bdb2-cc981f5011bc req-a8710ac0-5fa6-4870-8091-3824da23f24c service nova] Creating event network-vif-plugged:0a775fd5-0c4b-4d34-8fea-0665c23c121b for instance f78dee55-4357-4bb4-8057-ddecdd7326f6 on hv-cinder-79578 May 16 15:18:04.176886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-704ca317-8905-4e8b-bdb2-cc981f5011bc req-a8710ac0-5fa6-4870-8091-3824da23f24c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033336 May 16 15:18:04.177547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 200/399] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:18:04.230122 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e539733c-786a-4e1d-a429-4caee7792d0d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:04.231454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e539733c-786a-4e1d-a429-4caee7792d0d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:04.239590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e539733c-786a-4e1d-a429-4caee7792d0d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.244389 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e539733c-786a-4e1d-a429-4caee7792d0d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.244389 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e539733c-786a-4e1d-a429-4caee7792d0d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.244389 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e539733c-786a-4e1d-a429-4caee7792d0d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.311460 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-69f91bad-6f6e-437e-aa35-85c07f276a34 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:04.320897 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-69f91bad-6f6e-437e-aa35-85c07f276a34 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1549 microversion: 2.1 time: 0.260174 May 16 15:18:04.339478 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 200/400] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:04 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1549 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:04.346918 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e9af7ef8-5f8c-45f7-b095-2ee8fa86c484 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:04.353369 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e9af7ef8-5f8c-45f7-b095-2ee8fa86c484 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:04.361942 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e9af7ef8-5f8c-45f7-b095-2ee8fa86c484 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.362099 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e9af7ef8-5f8c-45f7-b095-2ee8fa86c484 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.363236 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e9af7ef8-5f8c-45f7-b095-2ee8fa86c484 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.363438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e9af7ef8-5f8c-45f7-b095-2ee8fa86c484 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.437644 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e539733c-786a-4e1d-a429-4caee7792d0d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:04.446693 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e539733c-786a-4e1d-a429-4caee7792d0d tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.222740 May 16 15:18:04.447600 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 201/401] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:04 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:04.567210 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e9af7ef8-5f8c-45f7-b095-2ee8fa86c484 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:04.576732 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e9af7ef8-5f8c-45f7-b095-2ee8fa86c484 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1549 microversion: 2.1 time: 0.235076 May 16 15:18:04.577678 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 201/402] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:04 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1549 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:04.595642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d808d2a0-62d5-4585-b1eb-bd215613153d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:04.599272 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d808d2a0-62d5-4585-b1eb-bd215613153d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:04.601485 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d808d2a0-62d5-4585-b1eb-bd215613153d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Searching by: {'deleted': False, 'project_id': '18afd7d9815342c196be824d2b99d537'} {{(pid=117649) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 16 15:18:04.609113 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d808d2a0-62d5-4585-b1eb-bd215613153d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.609889 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d808d2a0-62d5-4585-b1eb-bd215613153d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.610918 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d808d2a0-62d5-4585-b1eb-bd215613153d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.611576 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d808d2a0-62d5-4585-b1eb-bd215613153d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.715654 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.multi_cell_list [None req-d808d2a0-62d5-4585-b1eb-bd215613153d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117649) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 16 15:18:04.822273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d808d2a0-62d5-4585-b1eb-bd215613153d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.230499 May 16 15:18:04.822858 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 202/403] 10.222.0.44 () {58 vars in 1124 bytes} [Mon May 16 15:18:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:04.834409 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-acfdf93e-8330-405f-9475-eb9e139c3612 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:04.835372 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-acfdf93e-8330-405f-9475-eb9e139c3612 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:04.841966 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-acfdf93e-8330-405f-9475-eb9e139c3612 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.842446 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-acfdf93e-8330-405f-9475-eb9e139c3612 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:04.843214 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-acfdf93e-8330-405f-9475-eb9e139c3612 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:04.843870 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-acfdf93e-8330-405f-9475-eb9e139c3612 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:05.003660 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-acfdf93e-8330-405f-9475-eb9e139c3612 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:05.014046 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-acfdf93e-8330-405f-9475-eb9e139c3612 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1549 microversion: 2.1 time: 0.181704 May 16 15:18:05.016604 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 202/404] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:04 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1549 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:05.463300 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-87d69627-6499-47b3-b61f-5e03e2c4abd9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:05.463915 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-87d69627-6499-47b3-b61f-5e03e2c4abd9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:05.470603 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87d69627-6499-47b3-b61f-5e03e2c4abd9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:05.471059 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87d69627-6499-47b3-b61f-5e03e2c4abd9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:05.471831 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87d69627-6499-47b3-b61f-5e03e2c4abd9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:05.472262 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87d69627-6499-47b3-b61f-5e03e2c4abd9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:05.681271 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-87d69627-6499-47b3-b61f-5e03e2c4abd9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:05.689913 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-87d69627-6499-47b3-b61f-5e03e2c4abd9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.230889 May 16 15:18:05.691183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 203/405] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:05 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:06.707405 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2b14fcae-e412-4244-a702-3e2df95ed46e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:06.708057 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2b14fcae-e412-4244-a702-3e2df95ed46e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:06.714617 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b14fcae-e412-4244-a702-3e2df95ed46e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:06.715071 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b14fcae-e412-4244-a702-3e2df95ed46e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:06.718805 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b14fcae-e412-4244-a702-3e2df95ed46e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:06.718805 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b14fcae-e412-4244-a702-3e2df95ed46e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:07.241385 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2b14fcae-e412-4244-a702-3e2df95ed46e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:07.249136 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2b14fcae-e412-4244-a702-3e2df95ed46e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1371 microversion: 2.1 time: 0.545554 May 16 15:18:07.250271 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 203/406] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:06 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1371 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:07.284778 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2761b26a-fe72-4228-8c82-6c7bb56d933f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c23d5a3e-4134-49df-bf05-46017bf00606"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:07.287404 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2761b26a-fe72-4228-8c82-6c7bb56d933f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:07.295108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2761b26a-fe72-4228-8c82-6c7bb56d933f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:07.298327 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2761b26a-fe72-4228-8c82-6c7bb56d933f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:07.300345 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2761b26a-fe72-4228-8c82-6c7bb56d933f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:07.302827 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2761b26a-fe72-4228-8c82-6c7bb56d933f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:08.192957 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2761b26a-fe72-4228-8c82-6c7bb56d933f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "POST /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.912477 May 16 15:18:08.193918 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 204/407] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:18:07 2022] POST /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments => generated 194 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:08.266331 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d82fd125-35e1-42f9-8400-25155e23fcd0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:08.266935 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d82fd125-35e1-42f9-8400-25155e23fcd0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:08.273858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d82fd125-35e1-42f9-8400-25155e23fcd0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:08.274447 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d82fd125-35e1-42f9-8400-25155e23fcd0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:08.275273 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d82fd125-35e1-42f9-8400-25155e23fcd0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:08.276205 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d82fd125-35e1-42f9-8400-25155e23fcd0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:08.586010 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d82fd125-35e1-42f9-8400-25155e23fcd0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:08.594808 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d82fd125-35e1-42f9-8400-25155e23fcd0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1565 microversion: 2.1 time: 0.332725 May 16 15:18:08.595376 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 204/408] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:08 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1565 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:08.612990 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-45a90e90-f886-42a6-85c3-477385d100f7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:08.613717 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-45a90e90-f886-42a6-85c3-477385d100f7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:08.622429 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45a90e90-f886-42a6-85c3-477385d100f7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:08.625041 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45a90e90-f886-42a6-85c3-477385d100f7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:08.625041 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45a90e90-f886-42a6-85c3-477385d100f7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:08.625473 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45a90e90-f886-42a6-85c3-477385d100f7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:08.719318 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-45a90e90-f886-42a6-85c3-477385d100f7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111223 May 16 15:18:08.719745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 205/409] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 16 15:18:08 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:10.281301 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-87b97063-6219-4799-8e70-160de0c2bbb8 req-782bb005-1102-4b03-850d-466bed749493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f78dee55-4357-4bb4-8057-ddecdd7326f6", "tag": "0a775fd5-0c4b-4d34-8fea-0665c23c121b"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:10.309543 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-87b97063-6219-4799-8e70-160de0c2bbb8 req-782bb005-1102-4b03-850d-466bed749493 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:10.310096 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-87b97063-6219-4799-8e70-160de0c2bbb8 req-782bb005-1102-4b03-850d-466bed749493 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:10.325391 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-87b97063-6219-4799-8e70-160de0c2bbb8 req-782bb005-1102-4b03-850d-466bed749493 service nova] Creating event network-changed:0a775fd5-0c4b-4d34-8fea-0665c23c121b for instance f78dee55-4357-4bb4-8057-ddecdd7326f6 on hv-cinder-79578 May 16 15:18:10.336221 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-87b97063-6219-4799-8e70-160de0c2bbb8 req-782bb005-1102-4b03-850d-466bed749493 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059810 May 16 15:18:10.337530 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 205/410] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:18.180385 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-37a517ae-b7b9-4f95-be1c-b823896dba99 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Action: 'create', calling method: .version_select at 0x7fc9a75f3160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1195768707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwDiiyVzIPUYHVGkkk8l5UqaAgOQ9YGzn0AhkG2W8T73/RbaSNjVeLRwo+GWFbXdLEE5Lu2ElF1jFKkHCdjMp9os9nEqW6VaexxwCOpMFEDMK3gv4XWfKAN084qdxkWzQ=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:18.198736 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-37a517ae-b7b9-4f95-be1c-b823896dba99 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Getting quotas for project b025f7f102ee46fa92e9bb7445e59daa. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:18:18.202936 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-37a517ae-b7b9-4f95-be1c-b823896dba99 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Getting quotas for user b34f24054c204d7cb69ca41099913ca5 and project b025f7f102ee46fa92e9bb7445e59daa. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:18:18.308171 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-37a517ae-b7b9-4f95-be1c-b823896dba99 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.369599 May 16 15:18:18.309031 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 206/411] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 16 15:18:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:21.956333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-38694b76-e418-4e6c-9f7a-f75b806e7d88 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:21.957946 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-38694b76-e418-4e6c-9f7a-f75b806e7d88 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:21.969166 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38694b76-e418-4e6c-9f7a-f75b806e7d88 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:21.974799 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38694b76-e418-4e6c-9f7a-f75b806e7d88 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:21.974799 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38694b76-e418-4e6c-9f7a-f75b806e7d88 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:21.974799 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38694b76-e418-4e6c-9f7a-f75b806e7d88 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:22.121883 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-38694b76-e418-4e6c-9f7a-f75b806e7d88 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:22.129997 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-38694b76-e418-4e6c-9f7a-f75b806e7d88 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1595 microversion: 2.1 time: 0.179214 May 16 15:18:22.134142 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 206/412] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:21 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1595 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:24.682421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-d55e5e0b-6dfc-4d2f-b2cd-99f21990786c req-b0ce737b-50c1-492c-868d-af8d80232f96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2587084-89a0-47a8-909d-019d48b12e5c", "tag": "3904bae9-9274-4a0f-8757-bdbf49cf6aff"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:24.692017 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-d55e5e0b-6dfc-4d2f-b2cd-99f21990786c req-b0ce737b-50c1-492c-868d-af8d80232f96 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:24.692589 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-d55e5e0b-6dfc-4d2f-b2cd-99f21990786c req-b0ce737b-50c1-492c-868d-af8d80232f96 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:24.706643 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-d55e5e0b-6dfc-4d2f-b2cd-99f21990786c req-b0ce737b-50c1-492c-868d-af8d80232f96 service nova] Creating event network-changed:3904bae9-9274-4a0f-8757-bdbf49cf6aff for instance f2587084-89a0-47a8-909d-019d48b12e5c on hv-cinder-79578 May 16 15:18:24.712865 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-d55e5e0b-6dfc-4d2f-b2cd-99f21990786c req-b0ce737b-50c1-492c-868d-af8d80232f96 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034087 May 16 15:18:24.716782 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 207/413] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:27.003301 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4d0a6564-5003-406c-a9bc-cda2563417a1 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1332313170"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:27.003893 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4d0a6564-5003-406c-a9bc-cda2563417a1 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:27.010951 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d0a6564-5003-406c-a9bc-cda2563417a1 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:27.011399 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d0a6564-5003-406c-a9bc-cda2563417a1 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:27.012179 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d0a6564-5003-406c-a9bc-cda2563417a1 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:27.012613 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d0a6564-5003-406c-a9bc-cda2563417a1 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:27.139984 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.network.security_group_api [None req-4d0a6564-5003-406c-a9bc-cda2563417a1 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Adding security group bd80e2ed-795d-481f-ae0d-33b1c9403e7c to port 3904bae9-9274-4a0f-8757-bdbf49cf6aff May 16 15:18:27.638143 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4d0a6564-5003-406c-a9bc-cda2563417a1 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "POST /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/action" status: 202 len: 0 microversion: 2.1 time: 0.638971 May 16 15:18:27.644545 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 207/414] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:18:26 2022] POST /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:18:27.649279 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-b34cedd3-cbd6-4422-b0cf-d7835080e748 req-21c88c71-e6e4-4a64-8ad0-c0086ada0a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2587084-89a0-47a8-909d-019d48b12e5c", "tag": "3904bae9-9274-4a0f-8757-bdbf49cf6aff"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:27.650303 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1e507bae-7212-4ad2-bd8c-f64ad83a53c4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:27.651009 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1e507bae-7212-4ad2-bd8c-f64ad83a53c4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:27.657746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e507bae-7212-4ad2-bd8c-f64ad83a53c4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:27.658429 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e507bae-7212-4ad2-bd8c-f64ad83a53c4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:27.659359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e507bae-7212-4ad2-bd8c-f64ad83a53c4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:27.659787 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e507bae-7212-4ad2-bd8c-f64ad83a53c4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:27.668896 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-b34cedd3-cbd6-4422-b0cf-d7835080e748 req-21c88c71-e6e4-4a64-8ad0-c0086ada0a5c service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:27.669310 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-b34cedd3-cbd6-4422-b0cf-d7835080e748 req-21c88c71-e6e4-4a64-8ad0-c0086ada0a5c service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:27.695039 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-b34cedd3-cbd6-4422-b0cf-d7835080e748 req-21c88c71-e6e4-4a64-8ad0-c0086ada0a5c service nova] Creating event network-changed:3904bae9-9274-4a0f-8757-bdbf49cf6aff for instance f2587084-89a0-47a8-909d-019d48b12e5c on hv-cinder-79578 May 16 15:18:27.700955 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-b34cedd3-cbd6-4422-b0cf-d7835080e748 req-21c88c71-e6e4-4a64-8ad0-c0086ada0a5c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055900 May 16 15:18:27.702653 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 208/415] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:27.878423 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1e507bae-7212-4ad2-bd8c-f64ad83a53c4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:27.887682 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1e507bae-7212-4ad2-bd8c-f64ad83a53c4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1760 microversion: 2.1 time: 0.241312 May 16 15:18:27.888256 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 208/416] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:27 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1760 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:43.041571 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2002880598", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1195768707", "security_groups": [{"name": "tempest-secgroup-smoke-649752004"}], "block_device_mapping_v2": [{"uuid": "69cacaa1-520b-44f7-a2b7-895812c09d21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f80dbf35-88c8-44d8-af2b-bea94475a461"}]}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:43.152876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] validate_networks() for [('f80dbf35-88c8-44d8-af2b-bea94475a461', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:18:43.513022 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:18:43.513441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:18:43.513915 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:18:43.514360 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:18:43.514768 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:18:43.524154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:43.524605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:43.525442 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:43.525878 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:43.542018 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Getting quotas for project b025f7f102ee46fa92e9bb7445e59daa. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:18:43.545992 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Getting quotas for user b34f24054c204d7cb69ca41099913ca5 and project b025f7f102ee46fa92e9bb7445e59daa. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:18:43.602079 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:18:43.604356 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69cacaa1-520b-44f7-a2b7-895812c09d21',volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:18:43.948333 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9e27560b-d039-40d6-8fa9-ec49812f7106 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.911414 May 16 15:18:43.948990 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 209/417] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:18:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:18:43.958931 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dff285cf-3816-4710-b5a5-b667f0f09d2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:43.959620 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dff285cf-3816-4710-b5a5-b667f0f09d2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:44.017224 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-dff285cf-3816-4710-b5a5-b667f0f09d2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:44.024287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dff285cf-3816-4710-b5a5-b667f0f09d2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1095 microversion: 2.1 time: 0.069270 May 16 15:18:44.024861 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 209/418] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:43 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:45.041614 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-09553a48-42bf-412c-b0a4-0833c236a0b9 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:45.042257 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-09553a48-42bf-412c-b0a4-0833c236a0b9 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:45.048448 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09553a48-42bf-412c-b0a4-0833c236a0b9 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:45.048899 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09553a48-42bf-412c-b0a4-0833c236a0b9 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:45.049684 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09553a48-42bf-412c-b0a4-0833c236a0b9 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:45.050775 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09553a48-42bf-412c-b0a4-0833c236a0b9 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:45.112460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-09553a48-42bf-412c-b0a4-0833c236a0b9 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:45.119594 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-09553a48-42bf-412c-b0a4-0833c236a0b9 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1145 microversion: 2.1 time: 0.082443 May 16 15:18:45.120156 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 210/419] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:45 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:46.138899 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-19c3b263-47ce-4153-baf1-5f3be617f107 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:46.140519 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-19c3b263-47ce-4153-baf1-5f3be617f107 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:46.150337 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19c3b263-47ce-4153-baf1-5f3be617f107 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:46.150873 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19c3b263-47ce-4153-baf1-5f3be617f107 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:46.151789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19c3b263-47ce-4153-baf1-5f3be617f107 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:46.152370 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19c3b263-47ce-4153-baf1-5f3be617f107 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:46.213904 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-19c3b263-47ce-4153-baf1-5f3be617f107 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:46.221555 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-19c3b263-47ce-4153-baf1-5f3be617f107 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1193 microversion: 2.1 time: 0.088474 May 16 15:18:46.222658 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 210/420] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:46 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:47.240769 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-53b64854-71ee-4a32-bbf3-86ef341962cd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:47.241382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-53b64854-71ee-4a32-bbf3-86ef341962cd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:47.248222 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53b64854-71ee-4a32-bbf3-86ef341962cd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:47.248668 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53b64854-71ee-4a32-bbf3-86ef341962cd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:47.249447 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53b64854-71ee-4a32-bbf3-86ef341962cd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:47.249882 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53b64854-71ee-4a32-bbf3-86ef341962cd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:47.441761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-53b64854-71ee-4a32-bbf3-86ef341962cd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:47.449179 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-53b64854-71ee-4a32-bbf3-86ef341962cd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1278 microversion: 2.1 time: 0.212411 May 16 15:18:47.449847 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 211/421] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:47 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:48.157844 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-42d1e8da-446b-487f-bbf5-86d6cb46451e req-82b186b2-1426-43f5-8dbc-aa41f3cf2911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4fdfaa8-6784-48ce-9d0e-f67d7560a677", "tag": "db5b37d8-c741-4890-90db-e06eab6bdb47"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:48.166389 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-42d1e8da-446b-487f-bbf5-86d6cb46451e req-82b186b2-1426-43f5-8dbc-aa41f3cf2911 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:48.167203 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-42d1e8da-446b-487f-bbf5-86d6cb46451e req-82b186b2-1426-43f5-8dbc-aa41f3cf2911 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:48.181997 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-42d1e8da-446b-487f-bbf5-86d6cb46451e req-82b186b2-1426-43f5-8dbc-aa41f3cf2911 service nova] Creating event network-changed:db5b37d8-c741-4890-90db-e06eab6bdb47 for instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 on hv-cinder-79578 May 16 15:18:48.187088 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-42d1e8da-446b-487f-bbf5-86d6cb46451e req-82b186b2-1426-43f5-8dbc-aa41f3cf2911 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032552 May 16 15:18:48.195675 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 211/422] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:48.466359 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2eeb7f3d-2fd3-43ae-b05a-87b5ccee7262 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:48.466966 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2eeb7f3d-2fd3-43ae-b05a-87b5ccee7262 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:48.473906 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2eeb7f3d-2fd3-43ae-b05a-87b5ccee7262 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:48.474375 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2eeb7f3d-2fd3-43ae-b05a-87b5ccee7262 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:48.475169 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2eeb7f3d-2fd3-43ae-b05a-87b5ccee7262 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:48.475605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2eeb7f3d-2fd3-43ae-b05a-87b5ccee7262 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:48.672452 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2eeb7f3d-2fd3-43ae-b05a-87b5ccee7262 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:48.680230 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2eeb7f3d-2fd3-43ae-b05a-87b5ccee7262 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.217954 May 16 15:18:48.680791 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 212/423] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:48 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:49.698071 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b7065602-3ea0-42e7-8321-65ea5c936e58 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:49.698779 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b7065602-3ea0-42e7-8321-65ea5c936e58 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:49.704934 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7065602-3ea0-42e7-8321-65ea5c936e58 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:49.705381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7065602-3ea0-42e7-8321-65ea5c936e58 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:49.706184 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7065602-3ea0-42e7-8321-65ea5c936e58 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:49.706621 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7065602-3ea0-42e7-8321-65ea5c936e58 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:49.832396 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b7065602-3ea0-42e7-8321-65ea5c936e58 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:49.839637 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b7065602-3ea0-42e7-8321-65ea5c936e58 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.146215 May 16 15:18:49.840197 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 212/424] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:49 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:50.856465 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6f6da67a-4049-4067-8db6-6ec8613fcfb3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:50.857071 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6f6da67a-4049-4067-8db6-6ec8613fcfb3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:50.863466 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f6da67a-4049-4067-8db6-6ec8613fcfb3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:50.863954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f6da67a-4049-4067-8db6-6ec8613fcfb3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:50.864760 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f6da67a-4049-4067-8db6-6ec8613fcfb3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:50.865194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f6da67a-4049-4067-8db6-6ec8613fcfb3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:50.990709 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6f6da67a-4049-4067-8db6-6ec8613fcfb3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:50.998072 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6f6da67a-4049-4067-8db6-6ec8613fcfb3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.145587 May 16 15:18:50.998632 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 213/425] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:50 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:51.272192 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b9a5fb0d-0c53-470a-a428-d592a98ab6ac tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:51.272733 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b9a5fb0d-0c53-470a-a428-d592a98ab6ac tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:51.278966 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b9a5fb0d-0c53-470a-a428-d592a98ab6ac tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.279417 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b9a5fb0d-0c53-470a-a428-d592a98ab6ac tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.280183 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b9a5fb0d-0c53-470a-a428-d592a98ab6ac tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:51.280616 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b9a5fb0d-0c53-470a-a428-d592a98ab6ac tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:51.402590 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-b9a5fb0d-0c53-470a-a428-d592a98ab6ac tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lazy-loading 'services' on Instance uuid f3e68f7e-80df-470a-869e-8c625ab4709c {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:18:51.623936 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b9a5fb0d-0c53-470a-a428-d592a98ab6ac tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/os-volume_attachments/f29d1c95-e9d3-4efb-9a7a-97eed3a7ef28" status: 202 len: 0 microversion: 2.1 time: 0.355579 May 16 15:18:51.624629 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 213/426] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:18:51 2022] DELETE /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/os-volume_attachments/f29d1c95-e9d3-4efb-9a7a-97eed3a7ef28 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:18:52.015187 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-434f39fc-75da-4b34-ab71-bbb17e9f1984 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:52.015789 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-434f39fc-75da-4b34-ab71-bbb17e9f1984 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:52.022697 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-434f39fc-75da-4b34-ab71-bbb17e9f1984 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:52.023142 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-434f39fc-75da-4b34-ab71-bbb17e9f1984 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:52.023903 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-434f39fc-75da-4b34-ab71-bbb17e9f1984 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:52.024338 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-434f39fc-75da-4b34-ab71-bbb17e9f1984 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:52.155609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-434f39fc-75da-4b34-ab71-bbb17e9f1984 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:52.163550 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-434f39fc-75da-4b34-ab71-bbb17e9f1984 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.152212 May 16 15:18:52.164117 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 214/427] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:52 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:53.181639 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2cdc7217-c22d-4f8e-ae0f-2e6888241ce5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:53.182383 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2cdc7217-c22d-4f8e-ae0f-2e6888241ce5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:53.189250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cdc7217-c22d-4f8e-ae0f-2e6888241ce5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:53.189861 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cdc7217-c22d-4f8e-ae0f-2e6888241ce5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:53.190657 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cdc7217-c22d-4f8e-ae0f-2e6888241ce5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:53.191146 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cdc7217-c22d-4f8e-ae0f-2e6888241ce5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:53.323261 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2cdc7217-c22d-4f8e-ae0f-2e6888241ce5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:53.330414 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2cdc7217-c22d-4f8e-ae0f-2e6888241ce5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.153631 May 16 15:18:53.331303 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 214/428] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:53 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:53.782733 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-89295ed3-f6fe-4f90-b91e-395e215ae5cd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:53.789185 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89295ed3-f6fe-4f90-b91e-395e215ae5cd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:53.789633 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89295ed3-f6fe-4f90-b91e-395e215ae5cd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:53.810406 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-89295ed3-f6fe-4f90-b91e-395e215ae5cd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Going to try to stop instance {{(pid=117649) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 15:18:53.965921 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-89295ed3-f6fe-4f90-b91e-395e215ae5cd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "POST /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/action" status: 202 len: 0 microversion: 2.1 time: 0.186594 May 16 15:18:53.966588 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 215/429] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:18:53 2022] POST /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:18:53.974715 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3fa87bda-359b-47e8-b7fc-d03e84aab975 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:53.975324 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3fa87bda-359b-47e8-b7fc-d03e84aab975 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:53.981342 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3fa87bda-359b-47e8-b7fc-d03e84aab975 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:53.981845 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3fa87bda-359b-47e8-b7fc-d03e84aab975 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:53.982828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3fa87bda-359b-47e8-b7fc-d03e84aab975 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:53.983212 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3fa87bda-359b-47e8-b7fc-d03e84aab975 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:54.120659 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3fa87bda-359b-47e8-b7fc-d03e84aab975 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:54.129339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3fa87bda-359b-47e8-b7fc-d03e84aab975 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.157677 May 16 15:18:54.129693 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 215/430] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:53 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:54.347533 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bb5af72b-9e00-44da-be63-4da22a5c7d5a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:54.348230 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bb5af72b-9e00-44da-be63-4da22a5c7d5a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:54.354234 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb5af72b-9e00-44da-be63-4da22a5c7d5a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:54.354682 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb5af72b-9e00-44da-be63-4da22a5c7d5a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:54.355444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb5af72b-9e00-44da-be63-4da22a5c7d5a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:54.355882 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb5af72b-9e00-44da-be63-4da22a5c7d5a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:54.487457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bb5af72b-9e00-44da-be63-4da22a5c7d5a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:54.495405 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bb5af72b-9e00-44da-be63-4da22a5c7d5a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.152005 May 16 15:18:54.495968 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 216/431] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:54 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:55.147821 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f58c2df7-5faa-4bdc-aa3d-7fe0439d7bc7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:55.148430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f58c2df7-5faa-4bdc-aa3d-7fe0439d7bc7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:55.154896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f58c2df7-5faa-4bdc-aa3d-7fe0439d7bc7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:55.155348 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f58c2df7-5faa-4bdc-aa3d-7fe0439d7bc7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:55.156114 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f58c2df7-5faa-4bdc-aa3d-7fe0439d7bc7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:55.156551 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f58c2df7-5faa-4bdc-aa3d-7fe0439d7bc7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:55.283121 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f58c2df7-5faa-4bdc-aa3d-7fe0439d7bc7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:55.290374 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f58c2df7-5faa-4bdc-aa3d-7fe0439d7bc7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.146903 May 16 15:18:55.290943 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 216/432] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:55 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:55.512217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-278385dd-25af-4b16-8841-c1f3b582280f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:55.512771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-278385dd-25af-4b16-8841-c1f3b582280f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:55.519710 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-278385dd-25af-4b16-8841-c1f3b582280f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:55.520149 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-278385dd-25af-4b16-8841-c1f3b582280f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:55.520904 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-278385dd-25af-4b16-8841-c1f3b582280f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:55.521334 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-278385dd-25af-4b16-8841-c1f3b582280f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:55.649448 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-278385dd-25af-4b16-8841-c1f3b582280f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:55.656805 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-278385dd-25af-4b16-8841-c1f3b582280f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.148528 May 16 15:18:55.657367 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 217/433] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:55 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:56.308110 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1d7d1bc4-5643-4a29-96f6-7c6ba513fce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:56.308725 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1d7d1bc4-5643-4a29-96f6-7c6ba513fce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:56.315581 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d7d1bc4-5643-4a29-96f6-7c6ba513fce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:56.316037 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d7d1bc4-5643-4a29-96f6-7c6ba513fce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:56.316800 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d7d1bc4-5643-4a29-96f6-7c6ba513fce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:56.317804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d7d1bc4-5643-4a29-96f6-7c6ba513fce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:56.447729 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1d7d1bc4-5643-4a29-96f6-7c6ba513fce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:56.455014 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1d7d1bc4-5643-4a29-96f6-7c6ba513fce7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.150791 May 16 15:18:56.455573 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 217/434] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:56 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:56.672367 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f1cb14ba-6a02-4dc9-90c6-c88824d436c7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:56.672906 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f1cb14ba-6a02-4dc9-90c6-c88824d436c7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:56.679832 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1cb14ba-6a02-4dc9-90c6-c88824d436c7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:56.680275 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1cb14ba-6a02-4dc9-90c6-c88824d436c7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:56.681067 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1cb14ba-6a02-4dc9-90c6-c88824d436c7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:56.681498 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1cb14ba-6a02-4dc9-90c6-c88824d436c7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:56.812921 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f1cb14ba-6a02-4dc9-90c6-c88824d436c7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:56.820664 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f1cb14ba-6a02-4dc9-90c6-c88824d436c7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.152218 May 16 15:18:56.821224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 218/435] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:56 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:57.471948 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0fcbeb54-58aa-4ab0-81ea-263f82a7ff50 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:57.472642 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0fcbeb54-58aa-4ab0-81ea-263f82a7ff50 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:57.479194 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0fcbeb54-58aa-4ab0-81ea-263f82a7ff50 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:57.479689 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0fcbeb54-58aa-4ab0-81ea-263f82a7ff50 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:57.480452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0fcbeb54-58aa-4ab0-81ea-263f82a7ff50 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:57.480887 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0fcbeb54-58aa-4ab0-81ea-263f82a7ff50 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:57.605710 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0fcbeb54-58aa-4ab0-81ea-263f82a7ff50 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:57.613050 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0fcbeb54-58aa-4ab0-81ea-263f82a7ff50 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.145000 May 16 15:18:57.613621 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 218/436] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:57 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:57.837117 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-492385e7-660f-48af-bc93-cbacdeec9ea4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:57.837730 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-492385e7-660f-48af-bc93-cbacdeec9ea4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:57.844067 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-492385e7-660f-48af-bc93-cbacdeec9ea4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:57.844563 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-492385e7-660f-48af-bc93-cbacdeec9ea4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:57.845321 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-492385e7-660f-48af-bc93-cbacdeec9ea4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:57.845810 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-492385e7-660f-48af-bc93-cbacdeec9ea4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:57.973839 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-492385e7-660f-48af-bc93-cbacdeec9ea4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:57.981920 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-492385e7-660f-48af-bc93-cbacdeec9ea4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.148073 May 16 15:18:57.982703 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 219/437] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:57 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:58.312063 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-82f73af5-aa0c-441b-ad3c-80f21a8cb5a8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:58.312636 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-82f73af5-aa0c-441b-ad3c-80f21a8cb5a8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:58.318631 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82f73af5-aa0c-441b-ad3c-80f21a8cb5a8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.319076 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82f73af5-aa0c-441b-ad3c-80f21a8cb5a8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.319833 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82f73af5-aa0c-441b-ad3c-80f21a8cb5a8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.320265 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82f73af5-aa0c-441b-ad3c-80f21a8cb5a8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.332279 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-5a19e0a1-f0b3-4b1c-b8b6-1e12a593a338 req-dc76ae14-e73e-495f-a99b-f75609f23f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fdfaa8-6784-48ce-9d0e-f67d7560a677", "name": "network-vif-plugged", "status": "completed", "tag": "db5b37d8-c741-4890-90db-e06eab6bdb47"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:58.343041 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-5a19e0a1-f0b3-4b1c-b8b6-1e12a593a338 req-dc76ae14-e73e-495f-a99b-f75609f23f75 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.343041 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-5a19e0a1-f0b3-4b1c-b8b6-1e12a593a338 req-dc76ae14-e73e-495f-a99b-f75609f23f75 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.345197 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-82f73af5-aa0c-441b-ad3c-80f21a8cb5a8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab/ips" status: 200 len: 150 microversion: 2.1 time: 0.036972 May 16 15:18:58.345773 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 219/438] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 16 15:18:58 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:18:58.354902 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-5a19e0a1-f0b3-4b1c-b8b6-1e12a593a338 req-dc76ae14-e73e-495f-a99b-f75609f23f75 service nova] Creating event network-vif-plugged:db5b37d8-c741-4890-90db-e06eab6bdb47 for instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 on hv-cinder-79578 May 16 15:18:58.359156 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-951bdec7-1bd3-4450-940a-3ba23d291ca0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "320cd733-cfef-4c6d-98ec-3f88a526e053"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:18:58.359415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-951bdec7-1bd3-4450-940a-3ba23d291ca0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:58.367796 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-5a19e0a1-f0b3-4b1c-b8b6-1e12a593a338 req-dc76ae14-e73e-495f-a99b-f75609f23f75 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034177 May 16 15:18:58.367796 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 220/439] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:18:58.369190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-951bdec7-1bd3-4450-940a-3ba23d291ca0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.369190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-951bdec7-1bd3-4450-940a-3ba23d291ca0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.369190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-951bdec7-1bd3-4450-940a-3ba23d291ca0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.369190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-951bdec7-1bd3-4450-940a-3ba23d291ca0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.451084 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-951bdec7-1bd3-4450-940a-3ba23d291ca0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Invalid volume: volume 320cd733-cfef-4c6d-98ec-3f88a526e053 is already attached to instances: dd44422c-b621-4ad8-82ab-e5eeae7b2633 May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-951bdec7-1bd3-4450-940a-3ba23d291ca0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: POST /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab/os-volume_attachments HTTP/1.1 May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 74 May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:18:58.452819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {"volumeAttachment": {"volumeId": "320cd733-cfef-4c6d-98ec-3f88a526e053"}} May 16 15:18:58.458481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Invalid volume: volume 320cd733-cfef-4c6d-98ec-3f88a526e053 is already attached to instances: dd44422c-b621-4ad8-82ab-e5eeae7b2633 May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'server_id': 'e4a1a85a-fe23-4b81-a511-c153411ecfab', 'body': {'volumeAttachment': {'volumeId': '320cd733-cfef-4c6d-98ec-3f88a526e053'}}} May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 320cd733-cfef-4c6d-98ec-3f88a526e053 is already attached to instances: dd44422c-b621-4ad8-82ab-e5eeae7b2633 May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:18:58.459920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 320cd733-cfef-4c6d-98ec-3f88a526e053 is already attached to instances: dd44422c-b621-4ad8-82ab-e5eeae7b2633 May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:18:58.461148 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:18:58.462515 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:18:58.462515 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:18:58.462515 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:18:58.462515 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 320cd733-cfef-4c6d-98ec-3f88a526e053 is already attached to instances: dd44422c-b621-4ad8-82ab-e5eeae7b2633 May 16 15:18:58.462515 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:18:58.462515 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-951bdec7-1bd3-4450-940a-3ba23d291ca0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 400 to user: Invalid volume: volume 320cd733-cfef-4c6d-98ec-3f88a526e053 is already attached to instances: dd44422c-b621-4ad8-82ab-e5eeae7b2633 {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:18:58.462515 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-951bdec7-1bd3-4450-940a-3ba23d291ca0 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100075 May 16 15:18:58.462515 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 220/440] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:18:58 2022] POST /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 15:18:58.464931 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d23ac763-1d16-4715-9bfc-811383b3f351 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:58.465709 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d23ac763-1d16-4715-9bfc-811383b3f351 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:58.472451 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d23ac763-1d16-4715-9bfc-811383b3f351 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.472895 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d23ac763-1d16-4715-9bfc-811383b3f351 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.473666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d23ac763-1d16-4715-9bfc-811383b3f351 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.474142 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d23ac763-1d16-4715-9bfc-811383b3f351 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.498852 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d23ac763-1d16-4715-9bfc-811383b3f351 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:18:58.630037 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-20ed8d70-205f-4e87-b262-b43cc67dc12e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:58.630706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-20ed8d70-205f-4e87-b262-b43cc67dc12e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:58.638632 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20ed8d70-205f-4e87-b262-b43cc67dc12e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.639141 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20ed8d70-205f-4e87-b262-b43cc67dc12e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.639911 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20ed8d70-205f-4e87-b262-b43cc67dc12e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.640354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20ed8d70-205f-4e87-b262-b43cc67dc12e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.772062 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-20ed8d70-205f-4e87-b262-b43cc67dc12e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:58.779345 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-20ed8d70-205f-4e87-b262-b43cc67dc12e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.153179 May 16 15:18:58.779944 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 221/441] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:58 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:58.809554 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d23ac763-1d16-4715-9bfc-811383b3f351 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 204 len: 0 microversion: 2.1 time: 0.349664 May 16 15:18:58.810530 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 221/442] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:18:58 2022] DELETE /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:18:58.826955 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7ce69ebb-812a-4d44-8174-6f39661eebf7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:58.827558 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7ce69ebb-812a-4d44-8174-6f39661eebf7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:58.833403 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7ce69ebb-812a-4d44-8174-6f39661eebf7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.833854 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7ce69ebb-812a-4d44-8174-6f39661eebf7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.834640 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7ce69ebb-812a-4d44-8174-6f39661eebf7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:58.835078 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7ce69ebb-812a-4d44-8174-6f39661eebf7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:58.963082 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7ce69ebb-812a-4d44-8174-6f39661eebf7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:58.970690 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7ce69ebb-812a-4d44-8174-6f39661eebf7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1680 microversion: 2.1 time: 0.147559 May 16 15:18:58.971248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 222/443] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:58 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:18:58.999983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-27a076e3-8ae1-49ff-90dc-527808324491 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:59.000772 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-27a076e3-8ae1-49ff-90dc-527808324491 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:59.007471 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27a076e3-8ae1-49ff-90dc-527808324491 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:59.008003 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27a076e3-8ae1-49ff-90dc-527808324491 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:59.008774 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27a076e3-8ae1-49ff-90dc-527808324491 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:59.009204 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27a076e3-8ae1-49ff-90dc-527808324491 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:59.142581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-27a076e3-8ae1-49ff-90dc-527808324491 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:59.149856 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-27a076e3-8ae1-49ff-90dc-527808324491 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.154006 May 16 15:18:59.150393 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 222/444] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:58 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:59.796388 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-28af52df-a32b-4e14-92f5-b4f5c45fdc9c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:59.797030 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-28af52df-a32b-4e14-92f5-b4f5c45fdc9c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:59.804117 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-28af52df-a32b-4e14-92f5-b4f5c45fdc9c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:59.806586 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-28af52df-a32b-4e14-92f5-b4f5c45fdc9c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:59.806586 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-28af52df-a32b-4e14-92f5-b4f5c45fdc9c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:59.806586 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-28af52df-a32b-4e14-92f5-b4f5c45fdc9c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:59.932440 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-28af52df-a32b-4e14-92f5-b4f5c45fdc9c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:18:59.939926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-28af52df-a32b-4e14-92f5-b4f5c45fdc9c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.147400 May 16 15:18:59.940492 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 223/445] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:59 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:18:59.988513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8703880e-348b-4921-a7bf-6b8f52512e39 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:18:59.989128 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8703880e-348b-4921-a7bf-6b8f52512e39 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:18:59.995534 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8703880e-348b-4921-a7bf-6b8f52512e39 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:59.995982 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8703880e-348b-4921-a7bf-6b8f52512e39 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:18:59.996747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8703880e-348b-4921-a7bf-6b8f52512e39 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:18:59.997183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8703880e-348b-4921-a7bf-6b8f52512e39 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:00.128019 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8703880e-348b-4921-a7bf-6b8f52512e39 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:00.135313 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8703880e-348b-4921-a7bf-6b8f52512e39 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1680 microversion: 2.1 time: 0.150636 May 16 15:19:00.135868 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 223/446] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:18:59 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:00.174465 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4dc8e1ae-537e-42b3-8fa6-d734ecdcb722 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:00.176060 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4dc8e1ae-537e-42b3-8fa6-d734ecdcb722 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:00.180989 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4dc8e1ae-537e-42b3-8fa6-d734ecdcb722 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:00.181507 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4dc8e1ae-537e-42b3-8fa6-d734ecdcb722 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:00.182361 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4dc8e1ae-537e-42b3-8fa6-d734ecdcb722 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:00.182859 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4dc8e1ae-537e-42b3-8fa6-d734ecdcb722 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:00.314826 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4dc8e1ae-537e-42b3-8fa6-d734ecdcb722 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:00.322862 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4dc8e1ae-537e-42b3-8fa6-d734ecdcb722 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.152197 May 16 15:19:00.323435 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 224/447] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:00 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:00.445709 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-14392235-0ebf-45cd-8774-c8e74cf22bb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:00.446753 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-14392235-0ebf-45cd-8774-c8e74cf22bb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:00.452739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14392235-0ebf-45cd-8774-c8e74cf22bb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:00.453196 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14392235-0ebf-45cd-8774-c8e74cf22bb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:00.454172 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14392235-0ebf-45cd-8774-c8e74cf22bb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:00.454560 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14392235-0ebf-45cd-8774-c8e74cf22bb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:00.712359 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-14392235-0ebf-45cd-8774-c8e74cf22bb4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "POST /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/action" status: 202 len: 0 microversion: 2.1 time: 0.262972 May 16 15:19:00.712359 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 224/448] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:19:00 2022] POST /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:19:00.719718 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-47da8bae-6536-4cb4-ac67-085095aa884b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:00.720333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-47da8bae-6536-4cb4-ac67-085095aa884b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:00.726634 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-47da8bae-6536-4cb4-ac67-085095aa884b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:00.727082 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-47da8bae-6536-4cb4-ac67-085095aa884b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:00.727848 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-47da8bae-6536-4cb4-ac67-085095aa884b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:00.728276 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-47da8bae-6536-4cb4-ac67-085095aa884b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:00.871154 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-47da8bae-6536-4cb4-ac67-085095aa884b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:00.879141 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-47da8bae-6536-4cb4-ac67-085095aa884b tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1752 microversion: 2.1 time: 0.163695 May 16 15:19:00.879704 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 225/449] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:00 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:00.957350 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-64c87d76-1c76-49f0-84cc-80e59cd01696 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:00.958048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-64c87d76-1c76-49f0-84cc-80e59cd01696 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:00.964786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64c87d76-1c76-49f0-84cc-80e59cd01696 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:00.965233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64c87d76-1c76-49f0-84cc-80e59cd01696 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:00.965997 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64c87d76-1c76-49f0-84cc-80e59cd01696 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:00.966458 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64c87d76-1c76-49f0-84cc-80e59cd01696 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.101480 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-64c87d76-1c76-49f0-84cc-80e59cd01696 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:01.107798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-64c87d76-1c76-49f0-84cc-80e59cd01696 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.154768 May 16 15:19:01.108417 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 225/450] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:00 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:01.152768 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-622efcbb-fa06-49d9-a293-e5a31f0f3c44 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:01.153374 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-622efcbb-fa06-49d9-a293-e5a31f0f3c44 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:01.159241 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-622efcbb-fa06-49d9-a293-e5a31f0f3c44 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.159698 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-622efcbb-fa06-49d9-a293-e5a31f0f3c44 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.160455 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-622efcbb-fa06-49d9-a293-e5a31f0f3c44 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.160891 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-622efcbb-fa06-49d9-a293-e5a31f0f3c44 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.285570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-622efcbb-fa06-49d9-a293-e5a31f0f3c44 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:01.293278 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-622efcbb-fa06-49d9-a293-e5a31f0f3c44 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1680 microversion: 2.1 time: 0.144454 May 16 15:19:01.293856 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 226/451] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:01 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:01.338729 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-84a77064-97ac-42ba-bd0c-3ce5e053cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:01.339339 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-84a77064-97ac-42ba-bd0c-3ce5e053cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:01.345222 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84a77064-97ac-42ba-bd0c-3ce5e053cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.345675 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84a77064-97ac-42ba-bd0c-3ce5e053cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.346468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84a77064-97ac-42ba-bd0c-3ce5e053cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.346908 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84a77064-97ac-42ba-bd0c-3ce5e053cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.478561 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-84a77064-97ac-42ba-bd0c-3ce5e053cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:01.486045 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-84a77064-97ac-42ba-bd0c-3ce5e053cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.151221 May 16 15:19:01.486634 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 226/452] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:01 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:01.896526 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e85b00e2-3c29-4bf5-b049-326e0c9cbcce tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:01.897277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e85b00e2-3c29-4bf5-b049-326e0c9cbcce tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:01.905035 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e85b00e2-3c29-4bf5-b049-326e0c9cbcce tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.905559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e85b00e2-3c29-4bf5-b049-326e0c9cbcce tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:01.906438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e85b00e2-3c29-4bf5-b049-326e0c9cbcce tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:01.906936 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e85b00e2-3c29-4bf5-b049-326e0c9cbcce tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.064670 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e85b00e2-3c29-4bf5-b049-326e0c9cbcce tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:02.073502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e85b00e2-3c29-4bf5-b049-326e0c9cbcce tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1752 microversion: 2.1 time: 0.181005 May 16 15:19:02.074104 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 227/453] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:01 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:02.125065 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-13492413-d367-485f-8050-92617a28dfd5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:02.125815 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-13492413-d367-485f-8050-92617a28dfd5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:02.132114 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13492413-d367-485f-8050-92617a28dfd5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.133539 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13492413-d367-485f-8050-92617a28dfd5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.133539 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13492413-d367-485f-8050-92617a28dfd5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.133738 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13492413-d367-485f-8050-92617a28dfd5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.310136 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ce289333-28fe-493d-b482-f5264fedbf33 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:02.310776 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ce289333-28fe-493d-b482-f5264fedbf33 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:02.317078 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce289333-28fe-493d-b482-f5264fedbf33 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.317495 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce289333-28fe-493d-b482-f5264fedbf33 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.318795 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce289333-28fe-493d-b482-f5264fedbf33 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.319332 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce289333-28fe-493d-b482-f5264fedbf33 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.358927 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-13492413-d367-485f-8050-92617a28dfd5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:02.379618 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-13492413-d367-485f-8050-92617a28dfd5 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.258317 May 16 15:19:02.380300 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 227/454] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:02 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:02.474468 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ce289333-28fe-493d-b482-f5264fedbf33 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:02.482001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ce289333-28fe-493d-b482-f5264fedbf33 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1680 microversion: 2.1 time: 0.175811 May 16 15:19:02.482606 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 228/455] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:02 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:02.503141 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-677e007d-b17d-4112-88bf-bbdc9717034e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:02.503745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-677e007d-b17d-4112-88bf-bbdc9717034e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:02.510241 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-677e007d-b17d-4112-88bf-bbdc9717034e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.510682 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-677e007d-b17d-4112-88bf-bbdc9717034e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.511441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-677e007d-b17d-4112-88bf-bbdc9717034e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.511865 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-677e007d-b17d-4112-88bf-bbdc9717034e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.762081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-677e007d-b17d-4112-88bf-bbdc9717034e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:02.771508 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-677e007d-b17d-4112-88bf-bbdc9717034e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1266 microversion: 2.1 time: 0.272039 May 16 15:19:02.772198 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 228/456] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:02 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:02.944021 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-0d07c0b7-a762-40bf-bc8c-6308988f2696 req-d9d63e4e-53a8-43ce-92b8-f6e0af3eb0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a1a85a-fe23-4b81-a511-c153411ecfab", "name": "network-vif-deleted", "tag": "d2cefc0a-b410-472a-ae99-63766e348766"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:02.953310 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-0d07c0b7-a762-40bf-bc8c-6308988f2696 req-d9d63e4e-53a8-43ce-92b8-f6e0af3eb0d1 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:02.953883 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-0d07c0b7-a762-40bf-bc8c-6308988f2696 req-d9d63e4e-53a8-43ce-92b8-f6e0af3eb0d1 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:02.965812 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-0d07c0b7-a762-40bf-bc8c-6308988f2696 req-d9d63e4e-53a8-43ce-92b8-f6e0af3eb0d1 service nova] Creating event network-vif-deleted:d2cefc0a-b410-472a-ae99-63766e348766 for instance e4a1a85a-fe23-4b81-a511-c153411ecfab on hv-cinder-79578 May 16 15:19:02.971967 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-0d07c0b7-a762-40bf-bc8c-6308988f2696 req-d9d63e4e-53a8-43ce-92b8-f6e0af3eb0d1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032768 May 16 15:19:02.977247 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 229/457] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:19:03.093744 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e373704d-94c9-4cd9-a6d1-bec45a90dcd5 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:03.094953 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e373704d-94c9-4cd9-a6d1-bec45a90dcd5 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:03.104707 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e373704d-94c9-4cd9-a6d1-bec45a90dcd5 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.108043 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e373704d-94c9-4cd9-a6d1-bec45a90dcd5 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.108043 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e373704d-94c9-4cd9-a6d1-bec45a90dcd5 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.108043 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e373704d-94c9-4cd9-a6d1-bec45a90dcd5 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.313911 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e373704d-94c9-4cd9-a6d1-bec45a90dcd5 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:03.323307 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e373704d-94c9-4cd9-a6d1-bec45a90dcd5 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1752 microversion: 2.1 time: 0.236174 May 16 15:19:03.323919 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 229/458] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:03 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1752 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:03.398166 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c9eb8e7b-f079-4ce3-80b3-b403dcd33d8b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:03.399409 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c9eb8e7b-f079-4ce3-80b3-b403dcd33d8b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:03.406815 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9eb8e7b-f079-4ce3-80b3-b403dcd33d8b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.407432 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9eb8e7b-f079-4ce3-80b3-b403dcd33d8b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.408378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9eb8e7b-f079-4ce3-80b3-b403dcd33d8b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.408852 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9eb8e7b-f079-4ce3-80b3-b403dcd33d8b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.500424 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6d554019-e0ff-4370-8644-3896cf8170cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:03.501659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6d554019-e0ff-4370-8644-3896cf8170cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:03.508208 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d554019-e0ff-4370-8644-3896cf8170cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.508932 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d554019-e0ff-4370-8644-3896cf8170cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.510912 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d554019-e0ff-4370-8644-3896cf8170cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.518380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d554019-e0ff-4370-8644-3896cf8170cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.561770 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d554019-e0ff-4370-8644-3896cf8170cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.562587 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d554019-e0ff-4370-8644-3896cf8170cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.563546 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-6d554019-e0ff-4370-8644-3896cf8170cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lazy-loading 'fault' on Instance uuid e4a1a85a-fe23-4b81-a511-c153411ecfab {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:03.576902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c9eb8e7b-f079-4ce3-80b3-b403dcd33d8b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:03.585669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c9eb8e7b-f079-4ce3-80b3-b403dcd33d8b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.192470 May 16 15:19:03.598403 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 230/459] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:03 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:03.611766 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6d554019-e0ff-4370-8644-3896cf8170cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:03.620601 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6d554019-e0ff-4370-8644-3896cf8170cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 200 len: 1330 microversion: 2.1 time: 0.124145 May 16 15:19:03.621257 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 230/460] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:03 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 1330 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:03.711499 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-406691626", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:03.769377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] validate_networks() for None {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:19:03.788564 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7f3c22aa-4220-431f-ade6-0c82e4266ec3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:03.789549 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7f3c22aa-4220-431f-ade6-0c82e4266ec3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:03.796364 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f3c22aa-4220-431f-ade6-0c82e4266ec3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.796881 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f3c22aa-4220-431f-ade6-0c82e4266ec3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.797893 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f3c22aa-4220-431f-ade6-0c82e4266ec3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:03.798549 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f3c22aa-4220-431f-ade6-0c82e4266ec3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:03.962443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7f3c22aa-4220-431f-ade6-0c82e4266ec3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:03.971561 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7f3c22aa-4220-431f-ade6-0c82e4266ec3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1453 microversion: 2.1 time: 0.186737 May 16 15:19:03.972468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 231/461] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:03 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:03.988991 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e3df142d-6d29-4e99-a3ab-c855e4fa6fcb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:03.989772 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e3df142d-6d29-4e99-a3ab-c855e4fa6fcb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:03.998574 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3df142d-6d29-4e99-a3ab-c855e4fa6fcb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.004354 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3df142d-6d29-4e99-a3ab-c855e4fa6fcb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.005678 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3df142d-6d29-4e99-a3ab-c855e4fa6fcb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.006381 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3df142d-6d29-4e99-a3ab-c855e4fa6fcb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.209679 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e3df142d-6d29-4e99-a3ab-c855e4fa6fcb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:04.218593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e3df142d-6d29-4e99-a3ab-c855e4fa6fcb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1453 microversion: 2.1 time: 0.233266 May 16 15:19:04.229812 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 232/462] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:03 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1453 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:04.340308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-465ba021-16ef-472f-b245-c49fc37d6747 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:04.341284 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-465ba021-16ef-472f-b245-c49fc37d6747 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:04.351774 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-465ba021-16ef-472f-b245-c49fc37d6747 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.352214 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-465ba021-16ef-472f-b245-c49fc37d6747 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.352995 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-465ba021-16ef-472f-b245-c49fc37d6747 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.353425 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-465ba021-16ef-472f-b245-c49fc37d6747 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.409760 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:19:04.410246 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:19:04.411655 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:19:04.412642 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:19:04.413073 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:19:04.432481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.432982 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.433789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.434257 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.455693 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Getting quotas for project a7a81cdda2b24d85a96f06585868e8f9. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:19:04.459907 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Getting quotas for user 94afa342faf7484a9ffb830db20d24d4 and project a7a81cdda2b24d85a96f06585868e8f9. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:19:04.471445 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:19:04.473808 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:19:04.567416 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-465ba021-16ef-472f-b245-c49fc37d6747 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:04.576249 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-465ba021-16ef-472f-b245-c49fc37d6747 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.239996 May 16 15:19:04.576821 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 233/463] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:04 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:04.602891 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ab557080-23d3-4d88-ba7e-ad9341355585 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:04.603522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ab557080-23d3-4d88-ba7e-ad9341355585 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:04.610315 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab557080-23d3-4d88-ba7e-ad9341355585 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.612362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab557080-23d3-4d88-ba7e-ad9341355585 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.612362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab557080-23d3-4d88-ba7e-ad9341355585 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.612362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab557080-23d3-4d88-ba7e-ad9341355585 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.616373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e2bf0137-1807-4263-aee5-789df3e30b5e tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909909 May 16 15:19:04.617620 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 231/464] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:19:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:19:04.631679 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e77317e2-7ff8-4991-91d6-e576173595d9 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:04.631679 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e77317e2-7ff8-4991-91d6-e576173595d9 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:04.708451 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e77317e2-7ff8-4991-91d6-e576173595d9 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:04.717142 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e77317e2-7ff8-4991-91d6-e576173595d9 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1214 microversion: 2.1 time: 0.093823 May 16 15:19:04.718495 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 232/465] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:04 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:04.724380 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c09b3c59-81a1-4654-aa3b-749cbd9e138b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:04.725478 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c09b3c59-81a1-4654-aa3b-749cbd9e138b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:04.733369 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c09b3c59-81a1-4654-aa3b-749cbd9e138b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.734016 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c09b3c59-81a1-4654-aa3b-749cbd9e138b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.735168 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c09b3c59-81a1-4654-aa3b-749cbd9e138b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:04.736225 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c09b3c59-81a1-4654-aa3b-749cbd9e138b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:04.760902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-c09b3c59-81a1-4654-aa3b-749cbd9e138b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c09b3c59-81a1-4654-aa3b-749cbd9e138b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab HTTP/1.1 May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:19:04.764820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:19:04.766463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': 'e4a1a85a-fe23-4b81-a511-c153411ecfab'} May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:19:04.767377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:19:04.768855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:19:04.770188 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c09b3c59-81a1-4654-aa3b-749cbd9e138b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:19:04.771576 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c09b3c59-81a1-4654-aa3b-749cbd9e138b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 404 len: 111 microversion: 2.1 time: 0.051046 May 16 15:19:04.772439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 233/466] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:04 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:19:04.782034 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8aa84ef7-8b9e-4a4a-b915-b14d99fd4b15 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '.version_select at 0x7fc9a6e27940>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:04.805512 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ab557080-23d3-4d88-ba7e-ad9341355585 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:04.822230 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ab557080-23d3-4d88-ba7e-ad9341355585 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.222999 May 16 15:19:04.832125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 234/467] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:04 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:04.866451 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8aa84ef7-8b9e-4a4a-b915-b14d99fd4b15 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-211185076" status: 202 len: 0 microversion: 2.1 time: 0.088500 May 16 15:19:04.867037 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 234/468] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 16 15:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-211185076 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:19:05.594393 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ccb007bd-9c5e-4ec2-b4f9-71ac02063aa7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:05.595977 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ccb007bd-9c5e-4ec2-b4f9-71ac02063aa7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:05.604913 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccb007bd-9c5e-4ec2-b4f9-71ac02063aa7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:05.607725 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccb007bd-9c5e-4ec2-b4f9-71ac02063aa7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:05.607725 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccb007bd-9c5e-4ec2-b4f9-71ac02063aa7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:05.607725 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccb007bd-9c5e-4ec2-b4f9-71ac02063aa7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:05.734639 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ea775430-ef75-4e11-9ef6-27496829db2b tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:05.735900 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ea775430-ef75-4e11-9ef6-27496829db2b tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:05.743578 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea775430-ef75-4e11-9ef6-27496829db2b tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:05.744270 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea775430-ef75-4e11-9ef6-27496829db2b tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:05.745352 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea775430-ef75-4e11-9ef6-27496829db2b tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:05.745966 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea775430-ef75-4e11-9ef6-27496829db2b tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:05.786485 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ccb007bd-9c5e-4ec2-b4f9-71ac02063aa7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:05.798698 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ccb007bd-9c5e-4ec2-b4f9-71ac02063aa7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.209766 May 16 15:19:05.810247 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 235/469] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:05 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:05.816583 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ea775430-ef75-4e11-9ef6-27496829db2b tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:05.831614 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ea775430-ef75-4e11-9ef6-27496829db2b tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1218 microversion: 2.1 time: 0.100801 May 16 15:19:05.845306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 235/470] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:05 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:05.848634 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-45effbc2-28c5-4866-9b2f-f3254257f11e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:05.850192 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-45effbc2-28c5-4866-9b2f-f3254257f11e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:05.857472 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45effbc2-28c5-4866-9b2f-f3254257f11e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:05.865764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45effbc2-28c5-4866-9b2f-f3254257f11e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:05.865764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45effbc2-28c5-4866-9b2f-f3254257f11e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:05.865764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45effbc2-28c5-4866-9b2f-f3254257f11e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.005993 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-54502e51-82af-4d1b-973a-f1346a8d59a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:06.006967 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-54502e51-82af-4d1b-973a-f1346a8d59a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:06.013343 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-45effbc2-28c5-4866-9b2f-f3254257f11e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:06.019509 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54502e51-82af-4d1b-973a-f1346a8d59a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.020228 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54502e51-82af-4d1b-973a-f1346a8d59a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.021703 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-45effbc2-28c5-4866-9b2f-f3254257f11e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.177259 May 16 15:19:06.022178 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54502e51-82af-4d1b-973a-f1346a8d59a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.026679 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54502e51-82af-4d1b-973a-f1346a8d59a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.026798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 236/471] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:05 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:06.112728 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-54502e51-82af-4d1b-973a-f1346a8d59a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lazy-loading 'services' on Instance uuid dd44422c-b621-4ad8-82ab-e5eeae7b2633 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:06.386257 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-54502e51-82af-4d1b-973a-f1346a8d59a3 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-volume_attachments/320cd733-cfef-4c6d-98ec-3f88a526e053" status: 202 len: 0 microversion: 2.1 time: 0.383873 May 16 15:19:06.387208 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 236/472] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:19:06 2022] DELETE /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-volume_attachments/320cd733-cfef-4c6d-98ec-3f88a526e053 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:19:06.397081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-935cc890-c07e-4a26-84eb-5ff69a1f5b27 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:06.398208 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-935cc890-c07e-4a26-84eb-5ff69a1f5b27 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:06.406217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-935cc890-c07e-4a26-84eb-5ff69a1f5b27 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.406782 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-935cc890-c07e-4a26-84eb-5ff69a1f5b27 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.407716 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-935cc890-c07e-4a26-84eb-5ff69a1f5b27 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.408223 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-935cc890-c07e-4a26-84eb-5ff69a1f5b27 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.438765 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-935cc890-c07e-4a26-84eb-5ff69a1f5b27 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046951 May 16 15:19:06.439361 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 237/473] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:19:06 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:06.589253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-084f5801-59e2-4ad3-a15b-ee12caf7f3bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0632c8ba-912c-4809-bfb6-faaf605c405d"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:06.590518 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-084f5801-59e2-4ad3-a15b-ee12caf7f3bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:06.596524 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-084f5801-59e2-4ad3-a15b-ee12caf7f3bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.599154 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-084f5801-59e2-4ad3-a15b-ee12caf7f3bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.599154 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-084f5801-59e2-4ad3-a15b-ee12caf7f3bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.599154 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-084f5801-59e2-4ad3-a15b-ee12caf7f3bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.782593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-ce5c832b-be49-4b48-b203-1b6a484c300b req-ccf9e0b3-68d1-4273-a1cb-ac56f64c1ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4fdfaa8-6784-48ce-9d0e-f67d7560a677", "tag": "db5b37d8-c741-4890-90db-e06eab6bdb47"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:06.791871 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ce5c832b-be49-4b48-b203-1b6a484c300b req-ccf9e0b3-68d1-4273-a1cb-ac56f64c1ceb service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.792457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ce5c832b-be49-4b48-b203-1b6a484c300b req-ccf9e0b3-68d1-4273-a1cb-ac56f64c1ceb service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.805713 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-ce5c832b-be49-4b48-b203-1b6a484c300b req-ccf9e0b3-68d1-4273-a1cb-ac56f64c1ceb service nova] Creating event network-changed:db5b37d8-c741-4890-90db-e06eab6bdb47 for instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 on hv-cinder-79578 May 16 15:19:06.810968 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-ce5c832b-be49-4b48-b203-1b6a484c300b req-ccf9e0b3-68d1-4273-a1cb-ac56f64c1ceb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031996 May 16 15:19:06.811425 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 238/474] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:06.820184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-02fb8dbc-9126-4781-aa09-badc10342f93 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:06.820878 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-02fb8dbc-9126-4781-aa09-badc10342f93 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:06.827382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02fb8dbc-9126-4781-aa09-badc10342f93 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.828238 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02fb8dbc-9126-4781-aa09-badc10342f93 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:06.829133 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02fb8dbc-9126-4781-aa09-badc10342f93 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:06.829650 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02fb8dbc-9126-4781-aa09-badc10342f93 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.017531 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-02fb8dbc-9126-4781-aa09-badc10342f93 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:07.025632 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-02fb8dbc-9126-4781-aa09-badc10342f93 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.209989 May 16 15:19:07.026237 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 239/475] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:06 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:07.030818 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-71377e9f-f671-45ed-ab60-80ebce4e0d95 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:07.031537 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-71377e9f-f671-45ed-ab60-80ebce4e0d95 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:07.038724 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71377e9f-f671-45ed-ab60-80ebce4e0d95 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:07.039206 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71377e9f-f671-45ed-ab60-80ebce4e0d95 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.039984 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71377e9f-f671-45ed-ab60-80ebce4e0d95 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:07.040419 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71377e9f-f671-45ed-ab60-80ebce4e0d95 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.103742 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-71377e9f-f671-45ed-ab60-80ebce4e0d95 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:07.111334 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-71377e9f-f671-45ed-ab60-80ebce4e0d95 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1274 microversion: 2.1 time: 0.084135 May 16 15:19:07.111904 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 240/476] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:07 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:07.116708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1586caaa-9fa7-4e7c-979e-1aa2d3f46a62 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:07.117311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1586caaa-9fa7-4e7c-979e-1aa2d3f46a62 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:07.122897 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1586caaa-9fa7-4e7c-979e-1aa2d3f46a62 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:07.123342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1586caaa-9fa7-4e7c-979e-1aa2d3f46a62 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.124103 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1586caaa-9fa7-4e7c-979e-1aa2d3f46a62 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:07.124543 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1586caaa-9fa7-4e7c-979e-1aa2d3f46a62 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.255066 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1586caaa-9fa7-4e7c-979e-1aa2d3f46a62 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:07.263168 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1586caaa-9fa7-4e7c-979e-1aa2d3f46a62 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.150336 May 16 15:19:07.263741 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 241/477] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:07 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:07.451665 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f84ba237-4e0f-4889-ae6c-70a63b8e0402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:07.453219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f84ba237-4e0f-4889-ae6c-70a63b8e0402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:07.462328 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f84ba237-4e0f-4889-ae6c-70a63b8e0402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:07.463020 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f84ba237-4e0f-4889-ae6c-70a63b8e0402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.464122 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f84ba237-4e0f-4889-ae6c-70a63b8e0402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:07.464801 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f84ba237-4e0f-4889-ae6c-70a63b8e0402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.506887 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f84ba237-4e0f-4889-ae6c-70a63b8e0402 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059432 May 16 15:19:07.507729 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 242/478] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:19:07 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:19:07.983574 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-084f5801-59e2-4ad3-a15b-ee12caf7f3bb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "POST /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.398309 May 16 15:19:07.984934 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 237/479] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:19:06 2022] POST /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments => generated 194 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:08.043388 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-844007b3-7599-4c89-9511-420b400415b9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:08.044548 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-844007b3-7599-4c89-9511-420b400415b9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:08.051893 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-844007b3-7599-4c89-9511-420b400415b9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.052917 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-844007b3-7599-4c89-9511-420b400415b9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.053709 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-844007b3-7599-4c89-9511-420b400415b9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.054177 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-844007b3-7599-4c89-9511-420b400415b9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.129459 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cbede33d-0abe-4ea3-8254-1f7fbd0cf41c tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:08.130596 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cbede33d-0abe-4ea3-8254-1f7fbd0cf41c tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:08.137200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cbede33d-0abe-4ea3-8254-1f7fbd0cf41c tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.137649 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cbede33d-0abe-4ea3-8254-1f7fbd0cf41c tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.138521 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cbede33d-0abe-4ea3-8254-1f7fbd0cf41c tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.138992 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cbede33d-0abe-4ea3-8254-1f7fbd0cf41c tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.212764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-844007b3-7599-4c89-9511-420b400415b9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:08.221076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-844007b3-7599-4c89-9511-420b400415b9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.181583 May 16 15:19:08.222487 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 243/480] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:08 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:08.225507 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cbede33d-0abe-4ea3-8254-1f7fbd0cf41c tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:08.234315 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cbede33d-0abe-4ea3-8254-1f7fbd0cf41c tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1272 microversion: 2.1 time: 0.109108 May 16 15:19:08.236393 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 238/481] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:08 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:08.280735 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-667632d3-d5dc-4466-a864-d56523994c34 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:08.281345 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-667632d3-d5dc-4466-a864-d56523994c34 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:08.288133 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-667632d3-d5dc-4466-a864-d56523994c34 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.288588 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-667632d3-d5dc-4466-a864-d56523994c34 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.289363 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-667632d3-d5dc-4466-a864-d56523994c34 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.289803 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-667632d3-d5dc-4466-a864-d56523994c34 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.431219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-667632d3-d5dc-4466-a864-d56523994c34 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:08.439009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-667632d3-d5dc-4466-a864-d56523994c34 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.162182 May 16 15:19:08.439575 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 244/482] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:08 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:08.518725 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b1473547-04cd-406c-9231-3ef2e371c4c9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:08.519786 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b1473547-04cd-406c-9231-3ef2e371c4c9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:08.527115 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b1473547-04cd-406c-9231-3ef2e371c4c9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.527643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b1473547-04cd-406c-9231-3ef2e371c4c9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.528486 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b1473547-04cd-406c-9231-3ef2e371c4c9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.529140 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b1473547-04cd-406c-9231-3ef2e371c4c9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.559776 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b1473547-04cd-406c-9231-3ef2e371c4c9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045461 May 16 15:19:08.560438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 239/483] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:19:08 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:19:08.620354 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-708f3564-de63-4775-a1b0-217374489c72 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:08.620859 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-708f3564-de63-4775-a1b0-217374489c72 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:08.627092 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-708f3564-de63-4775-a1b0-217374489c72 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.627545 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-708f3564-de63-4775-a1b0-217374489c72 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.628330 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-708f3564-de63-4775-a1b0-217374489c72 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.628766 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-708f3564-de63-4775-a1b0-217374489c72 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.656642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-708f3564-de63-4775-a1b0-217374489c72 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:19:08.943913 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-708f3564-de63-4775-a1b0-217374489c72 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 204 len: 0 microversion: 2.1 time: 0.327035 May 16 15:19:08.944426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 245/484] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:19:08 2022] DELETE /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:19:08.952527 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bfb4f1b0-bfef-4dd1-b0e2-9cfc775a7281 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:08.953123 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bfb4f1b0-bfef-4dd1-b0e2-9cfc775a7281 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:08.960158 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bfb4f1b0-bfef-4dd1-b0e2-9cfc775a7281 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.960618 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bfb4f1b0-bfef-4dd1-b0e2-9cfc775a7281 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.961365 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bfb4f1b0-bfef-4dd1-b0e2-9cfc775a7281 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.961789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bfb4f1b0-bfef-4dd1-b0e2-9cfc775a7281 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:09.139699 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bfb4f1b0-bfef-4dd1-b0e2-9cfc775a7281 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:09.146947 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bfb4f1b0-bfef-4dd1-b0e2-9cfc775a7281 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1679 microversion: 2.1 time: 0.198169 May 16 15:19:09.147753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 240/485] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:08 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:09.244966 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ccdc1df5-3ee4-409c-baba-af3513b1a46a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:09.249908 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ccdc1df5-3ee4-409c-baba-af3513b1a46a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:09.252459 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccdc1df5-3ee4-409c-baba-af3513b1a46a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:09.252907 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccdc1df5-3ee4-409c-baba-af3513b1a46a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:09.253746 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccdc1df5-3ee4-409c-baba-af3513b1a46a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:09.254216 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccdc1df5-3ee4-409c-baba-af3513b1a46a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:09.258841 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5cafda9d-3fe3-48a7-a177-cdc5b97344c5 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:09.260768 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5cafda9d-3fe3-48a7-a177-cdc5b97344c5 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:09.268322 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5cafda9d-3fe3-48a7-a177-cdc5b97344c5 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:09.268771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5cafda9d-3fe3-48a7-a177-cdc5b97344c5 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:09.269547 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5cafda9d-3fe3-48a7-a177-cdc5b97344c5 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:09.269993 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5cafda9d-3fe3-48a7-a177-cdc5b97344c5 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:09.430161 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ccdc1df5-3ee4-409c-baba-af3513b1a46a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:09.439001 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ccdc1df5-3ee4-409c-baba-af3513b1a46a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.198046 May 16 15:19:09.439590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 246/486] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:09 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:09.456104 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ea462f6e-96e7-4904-972f-d71e8eb0ddb1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:09.456632 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ea462f6e-96e7-4904-972f-d71e8eb0ddb1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:09.463080 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea462f6e-96e7-4904-972f-d71e8eb0ddb1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:09.463728 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea462f6e-96e7-4904-972f-d71e8eb0ddb1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:09.464510 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea462f6e-96e7-4904-972f-d71e8eb0ddb1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:09.464942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea462f6e-96e7-4904-972f-d71e8eb0ddb1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:09.472654 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5cafda9d-3fe3-48a7-a177-cdc5b97344c5 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:09.481890 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5cafda9d-3fe3-48a7-a177-cdc5b97344c5 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1314 microversion: 2.1 time: 0.233490 May 16 15:19:09.482862 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 241/487] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:09 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:09.594966 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ea462f6e-96e7-4904-972f-d71e8eb0ddb1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:09.612110 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ea462f6e-96e7-4904-972f-d71e8eb0ddb1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1676 microversion: 2.1 time: 0.159870 May 16 15:19:09.613714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 247/488] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:09 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:09.618216 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-8a9b97da-892c-40cc-92f8-1ac1b960d91d req-e812aec8-fa65-4f54-9abf-924607517eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360b2e08-f3cd-4e7d-b9ed-11951f9298e5", "tag": "311e02b9-6d73-4765-928b-2c32a920a727"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:09.627751 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-8a9b97da-892c-40cc-92f8-1ac1b960d91d req-e812aec8-fa65-4f54-9abf-924607517eb4 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:09.628208 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-8a9b97da-892c-40cc-92f8-1ac1b960d91d req-e812aec8-fa65-4f54-9abf-924607517eb4 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:09.643803 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-8a9b97da-892c-40cc-92f8-1ac1b960d91d req-e812aec8-fa65-4f54-9abf-924607517eb4 service nova] Creating event network-changed:311e02b9-6d73-4765-928b-2c32a920a727 for instance 360b2e08-f3cd-4e7d-b9ed-11951f9298e5 on hv-cinder-79578 May 16 15:19:09.648812 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-8a9b97da-892c-40cc-92f8-1ac1b960d91d req-e812aec8-fa65-4f54-9abf-924607517eb4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039129 May 16 15:19:09.649528 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 242/489] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:10.163560 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5252c63a-6915-4c4b-9444-13378dc125b1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:10.164173 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5252c63a-6915-4c4b-9444-13378dc125b1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:10.170009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5252c63a-6915-4c4b-9444-13378dc125b1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:10.170492 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5252c63a-6915-4c4b-9444-13378dc125b1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:10.171253 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5252c63a-6915-4c4b-9444-13378dc125b1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:10.171686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5252c63a-6915-4c4b-9444-13378dc125b1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:10.298755 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5252c63a-6915-4c4b-9444-13378dc125b1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:10.307049 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5252c63a-6915-4c4b-9444-13378dc125b1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1679 microversion: 2.1 time: 0.147180 May 16 15:19:10.307549 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 248/490] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:10 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:10.456428 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d542a3a4-760e-42d3-b540-f14f558564a6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:10.457108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d542a3a4-760e-42d3-b540-f14f558564a6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:10.463828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d542a3a4-760e-42d3-b540-f14f558564a6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:10.464276 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d542a3a4-760e-42d3-b540-f14f558564a6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:10.465027 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d542a3a4-760e-42d3-b540-f14f558564a6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:10.465459 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d542a3a4-760e-42d3-b540-f14f558564a6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:10.499420 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-44c6572b-801d-40ff-aba6-65609c513653 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:10.500029 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-44c6572b-801d-40ff-aba6-65609c513653 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:10.506938 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-44c6572b-801d-40ff-aba6-65609c513653 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:10.507509 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-44c6572b-801d-40ff-aba6-65609c513653 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:10.508291 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-44c6572b-801d-40ff-aba6-65609c513653 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:10.508726 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-44c6572b-801d-40ff-aba6-65609c513653 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:10.644569 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d542a3a4-760e-42d3-b540-f14f558564a6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:10.648152 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-44c6572b-801d-40ff-aba6-65609c513653 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:10.652562 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d542a3a4-760e-42d3-b540-f14f558564a6 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.200239 May 16 15:19:10.653140 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 243/491] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:10 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:10.655694 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-44c6572b-801d-40ff-aba6-65609c513653 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1314 microversion: 2.1 time: 0.160079 May 16 15:19:10.656475 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 249/492] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:10 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:10.657554 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-90547a8a-5d59-4a33-a2d7-02515814f5c7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:10.658177 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-90547a8a-5d59-4a33-a2d7-02515814f5c7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:10.665230 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90547a8a-5d59-4a33-a2d7-02515814f5c7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:10.665683 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90547a8a-5d59-4a33-a2d7-02515814f5c7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:10.666554 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90547a8a-5d59-4a33-a2d7-02515814f5c7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:10.666983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90547a8a-5d59-4a33-a2d7-02515814f5c7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:11.036656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-90547a8a-5d59-4a33-a2d7-02515814f5c7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:11.044436 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-90547a8a-5d59-4a33-a2d7-02515814f5c7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1653 microversion: 2.1 time: 0.390280 May 16 15:19:11.045017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 244/493] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:10 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1653 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:11.069389 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e475d849-9a99-478a-a487-fe668d003aa4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:11.076537 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e475d849-9a99-478a-a487-fe668d003aa4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:11.076986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e475d849-9a99-478a-a487-fe668d003aa4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:11.105292 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e475d849-9a99-478a-a487-fe668d003aa4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Going to try to start instance {{(pid=117649) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 15:19:11.266663 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e475d849-9a99-478a-a487-fe668d003aa4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "POST /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/action" status: 202 len: 0 microversion: 2.1 time: 0.201917 May 16 15:19:11.267303 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 250/494] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:19:11 2022] POST /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:19:11.275696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f3ad5bbe-abff-4897-ac34-7f9006bc5bb0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:11.276290 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f3ad5bbe-abff-4897-ac34-7f9006bc5bb0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:11.282100 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3ad5bbe-abff-4897-ac34-7f9006bc5bb0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:11.283934 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3ad5bbe-abff-4897-ac34-7f9006bc5bb0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:11.283934 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3ad5bbe-abff-4897-ac34-7f9006bc5bb0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:11.283934 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3ad5bbe-abff-4897-ac34-7f9006bc5bb0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:11.324621 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-84847b79-56c1-49d4-a995-000c9090dca9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:11.325317 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-84847b79-56c1-49d4-a995-000c9090dca9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:11.331535 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84847b79-56c1-49d4-a995-000c9090dca9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:11.331985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84847b79-56c1-49d4-a995-000c9090dca9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:11.332764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84847b79-56c1-49d4-a995-000c9090dca9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:11.333689 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84847b79-56c1-49d4-a995-000c9090dca9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:11.419470 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f3ad5bbe-abff-4897-ac34-7f9006bc5bb0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:11.427247 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f3ad5bbe-abff-4897-ac34-7f9006bc5bb0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1662 microversion: 2.1 time: 0.155161 May 16 15:19:11.427678 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 245/495] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:11 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:11.539353 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-84847b79-56c1-49d4-a995-000c9090dca9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:11.550240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-84847b79-56c1-49d4-a995-000c9090dca9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1679 microversion: 2.1 time: 0.229682 May 16 15:19:11.551083 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 251/496] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:11 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:11.670784 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b7946718-a3fe-4c7e-b827-ff481e458200 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:11.672624 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b7946718-a3fe-4c7e-b827-ff481e458200 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:11.672924 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6bd10980-95d8-4735-b1ff-caface3c66b6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:11.673590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6bd10980-95d8-4735-b1ff-caface3c66b6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:11.680403 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7946718-a3fe-4c7e-b827-ff481e458200 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:11.681024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bd10980-95d8-4735-b1ff-caface3c66b6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:11.681375 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7946718-a3fe-4c7e-b827-ff481e458200 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:11.681507 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bd10980-95d8-4735-b1ff-caface3c66b6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:11.682339 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bd10980-95d8-4735-b1ff-caface3c66b6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:11.682809 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bd10980-95d8-4735-b1ff-caface3c66b6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:11.683415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7946718-a3fe-4c7e-b827-ff481e458200 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:11.684051 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7946718-a3fe-4c7e-b827-ff481e458200 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:11.857106 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b7946718-a3fe-4c7e-b827-ff481e458200 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:11.868712 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b7946718-a3fe-4c7e-b827-ff481e458200 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.202671 May 16 15:19:11.869660 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 246/497] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:11 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:11.996512 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6bd10980-95d8-4735-b1ff-caface3c66b6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:12.007025 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6bd10980-95d8-4735-b1ff-caface3c66b6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1314 microversion: 2.1 time: 0.338193 May 16 15:19:12.007872 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 252/498] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:11 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:12.289550 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-85870295-0137-4634-a1fd-0af7b7cf7ae0 req-7d905f9d-7620-4f2a-85a5-d8920d6ee217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd44422c-b621-4ad8-82ab-e5eeae7b2633", "name": "network-vif-deleted", "tag": "a1eae8f4-b207-4d48-bdf5-dfab72b3d846"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:12.299557 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-85870295-0137-4634-a1fd-0af7b7cf7ae0 req-7d905f9d-7620-4f2a-85a5-d8920d6ee217 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.302373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-85870295-0137-4634-a1fd-0af7b7cf7ae0 req-7d905f9d-7620-4f2a-85a5-d8920d6ee217 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.315685 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-85870295-0137-4634-a1fd-0af7b7cf7ae0 req-7d905f9d-7620-4f2a-85a5-d8920d6ee217 service nova] Creating event network-vif-deleted:a1eae8f4-b207-4d48-bdf5-dfab72b3d846 for instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 on hv-cinder-79578 May 16 15:19:12.322732 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-85870295-0137-4634-a1fd-0af7b7cf7ae0 req-7d905f9d-7620-4f2a-85a5-d8920d6ee217 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039426 May 16 15:19:12.326760 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 247/499] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:12.355325 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9bda0c32-2b92-4c36-8d07-3bb7fdf589c1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:12.356326 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9bda0c32-2b92-4c36-8d07-3bb7fdf589c1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:12.362633 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bda0c32-2b92-4c36-8d07-3bb7fdf589c1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.363085 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bda0c32-2b92-4c36-8d07-3bb7fdf589c1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.363851 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bda0c32-2b92-4c36-8d07-3bb7fdf589c1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.364322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bda0c32-2b92-4c36-8d07-3bb7fdf589c1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.387348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-9bda0c32-2b92-4c36-8d07-3bb7fdf589c1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lazy-loading 'flavor' on Instance uuid f78dee55-4357-4bb4-8057-ddecdd7326f6 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:12.447536 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-156b0201-86ec-4a76-9d19-3b8a10af957b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:12.448352 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-156b0201-86ec-4a76-9d19-3b8a10af957b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:12.455073 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-156b0201-86ec-4a76-9d19-3b8a10af957b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.455619 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-156b0201-86ec-4a76-9d19-3b8a10af957b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.456482 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-156b0201-86ec-4a76-9d19-3b8a10af957b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.456990 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-156b0201-86ec-4a76-9d19-3b8a10af957b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.589079 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-156b0201-86ec-4a76-9d19-3b8a10af957b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:12.597866 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-156b0201-86ec-4a76-9d19-3b8a10af957b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1662 microversion: 2.1 time: 0.157481 May 16 15:19:12.602099 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 248/500] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:12 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:12.602894 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cd4d3305-6847-4d1e-b4ae-cf23612f926e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:12.603493 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cd4d3305-6847-4d1e-b4ae-cf23612f926e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:12.609442 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd4d3305-6847-4d1e-b4ae-cf23612f926e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.609894 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd4d3305-6847-4d1e-b4ae-cf23612f926e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.610696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd4d3305-6847-4d1e-b4ae-cf23612f926e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.611136 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd4d3305-6847-4d1e-b4ae-cf23612f926e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.676035 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cd4d3305-6847-4d1e-b4ae-cf23612f926e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:12.684554 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cd4d3305-6847-4d1e-b4ae-cf23612f926e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1612 microversion: 2.1 time: 0.085123 May 16 15:19:12.685124 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 249/501] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:12 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1612 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:12.742063 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9bda0c32-2b92-4c36-8d07-3bb7fdf589c1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "POST /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/action" status: 200 len: 32 microversion: 2.1 time: 0.390602 May 16 15:19:12.742853 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 253/502] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:19:12 2022] POST /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:19:12.751821 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-091314f0-9b9b-47f1-a455-4d355a206c75 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:12.752427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-091314f0-9b9b-47f1-a455-4d355a206c75 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:12.759095 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-091314f0-9b9b-47f1-a455-4d355a206c75 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.759541 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-091314f0-9b9b-47f1-a455-4d355a206c75 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.760305 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-091314f0-9b9b-47f1-a455-4d355a206c75 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.760737 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-091314f0-9b9b-47f1-a455-4d355a206c75 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.886101 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2d9ca6ad-dabf-42c3-9372-bf79eaa62922 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:12.887208 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2d9ca6ad-dabf-42c3-9372-bf79eaa62922 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:12.894894 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-091314f0-9b9b-47f1-a455-4d355a206c75 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:12.898173 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d9ca6ad-dabf-42c3-9372-bf79eaa62922 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.898632 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d9ca6ad-dabf-42c3-9372-bf79eaa62922 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.899419 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d9ca6ad-dabf-42c3-9372-bf79eaa62922 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:12.899855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d9ca6ad-dabf-42c3-9372-bf79eaa62922 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:12.903733 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-091314f0-9b9b-47f1-a455-4d355a206c75 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.155745 May 16 15:19:12.904394 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 250/503] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:12 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:13.024185 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8547a229-0723-41a8-9e1d-6766d0b9e3b2 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:13.024803 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8547a229-0723-41a8-9e1d-6766d0b9e3b2 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:13.030875 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8547a229-0723-41a8-9e1d-6766d0b9e3b2 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:13.031333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8547a229-0723-41a8-9e1d-6766d0b9e3b2 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:13.032124 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8547a229-0723-41a8-9e1d-6766d0b9e3b2 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:13.032562 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8547a229-0723-41a8-9e1d-6766d0b9e3b2 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:13.059379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2d9ca6ad-dabf-42c3-9372-bf79eaa62922 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:13.069445 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2d9ca6ad-dabf-42c3-9372-bf79eaa62922 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.187746 May 16 15:19:13.070185 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 254/504] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:12 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:13.182986 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8547a229-0723-41a8-9e1d-6766d0b9e3b2 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:13.189731 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8547a229-0723-41a8-9e1d-6766d0b9e3b2 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1314 microversion: 2.1 time: 0.169426 May 16 15:19:13.190369 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 251/505] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:13 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:13.615131 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-85e766de-e6b1-4e37-b069-6023d7d16034 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:13.615739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-85e766de-e6b1-4e37-b069-6023d7d16034 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:13.622293 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85e766de-e6b1-4e37-b069-6023d7d16034 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:13.622958 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85e766de-e6b1-4e37-b069-6023d7d16034 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:13.623893 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85e766de-e6b1-4e37-b069-6023d7d16034 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:13.624337 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85e766de-e6b1-4e37-b069-6023d7d16034 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:13.702678 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-88f989dd-3064-4fba-aa70-62f22de70b7c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:13.703220 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-88f989dd-3064-4fba-aa70-62f22de70b7c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:13.710042 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88f989dd-3064-4fba-aa70-62f22de70b7c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:13.710518 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88f989dd-3064-4fba-aa70-62f22de70b7c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:13.711277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88f989dd-3064-4fba-aa70-62f22de70b7c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:13.711704 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88f989dd-3064-4fba-aa70-62f22de70b7c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:13.743379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88f989dd-3064-4fba-aa70-62f22de70b7c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:13.743825 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88f989dd-3064-4fba-aa70-62f22de70b7c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:13.744268 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-88f989dd-3064-4fba-aa70-62f22de70b7c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lazy-loading 'fault' on Instance uuid dd44422c-b621-4ad8-82ab-e5eeae7b2633 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:19:13.785501 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-85e766de-e6b1-4e37-b069-6023d7d16034 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:13.786984 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88f989dd-3064-4fba-aa70-62f22de70b7c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:13.793903 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-85e766de-e6b1-4e37-b069-6023d7d16034 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1662 microversion: 2.1 time: 0.182600 May 16 15:19:13.794564 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 255/506] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:13 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1662 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:13.794795 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-88f989dd-3064-4fba-aa70-62f22de70b7c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 200 len: 1330 microversion: 2.1 time: 0.096026 May 16 15:19:13.795354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 252/507] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:13 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:13.920887 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fa0c8f7b-dfc2-45f4-8217-f671cf19dd6a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:13.921521 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fa0c8f7b-dfc2-45f4-8217-f671cf19dd6a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:13.928392 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa0c8f7b-dfc2-45f4-8217-f671cf19dd6a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:13.929077 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa0c8f7b-dfc2-45f4-8217-f671cf19dd6a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:13.929871 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa0c8f7b-dfc2-45f4-8217-f671cf19dd6a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:13.930347 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa0c8f7b-dfc2-45f4-8217-f671cf19dd6a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:14.086578 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-54589e8d-1ae6-42e8-8c10-6ab7f1e41e0e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:14.087191 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-54589e8d-1ae6-42e8-8c10-6ab7f1e41e0e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:14.093048 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54589e8d-1ae6-42e8-8c10-6ab7f1e41e0e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:14.093723 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54589e8d-1ae6-42e8-8c10-6ab7f1e41e0e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:14.094531 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54589e8d-1ae6-42e8-8c10-6ab7f1e41e0e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:14.094974 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54589e8d-1ae6-42e8-8c10-6ab7f1e41e0e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:14.184713 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fa0c8f7b-dfc2-45f4-8217-f671cf19dd6a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:14.192952 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fa0c8f7b-dfc2-45f4-8217-f671cf19dd6a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.276144 May 16 15:19:14.193720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 256/508] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:13 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:14.207018 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-06fb183f-a6b8-4f22-8004-41eb1043a6a0 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:14.207626 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-06fb183f-a6b8-4f22-8004-41eb1043a6a0 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:14.214492 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06fb183f-a6b8-4f22-8004-41eb1043a6a0 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:14.215203 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06fb183f-a6b8-4f22-8004-41eb1043a6a0 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:14.216241 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06fb183f-a6b8-4f22-8004-41eb1043a6a0 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:14.216890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06fb183f-a6b8-4f22-8004-41eb1043a6a0 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:14.294015 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-54589e8d-1ae6-42e8-8c10-6ab7f1e41e0e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:14.306031 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-54589e8d-1ae6-42e8-8c10-6ab7f1e41e0e tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.221823 May 16 15:19:14.307779 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 253/509] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:14 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:14.453464 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-06fb183f-a6b8-4f22-8004-41eb1043a6a0 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:14.461259 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-06fb183f-a6b8-4f22-8004-41eb1043a6a0 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1314 microversion: 2.1 time: 0.258950 May 16 15:19:14.461822 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 257/510] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:14 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:14.815123 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3123b8b3-e646-4872-ac46-4b85fd92ae63 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:14.815715 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3123b8b3-e646-4872-ac46-4b85fd92ae63 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:14.817948 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-93525905-4f93-413c-beaf-da5457b5e141 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:14.818598 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-93525905-4f93-413c-beaf-da5457b5e141 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:14.824909 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93525905-4f93-413c-beaf-da5457b5e141 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:14.825353 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93525905-4f93-413c-beaf-da5457b5e141 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:14.826160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93525905-4f93-413c-beaf-da5457b5e141 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:14.826618 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93525905-4f93-413c-beaf-da5457b5e141 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:14.836279 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3123b8b3-e646-4872-ac46-4b85fd92ae63 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:14.836662 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3123b8b3-e646-4872-ac46-4b85fd92ae63 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:14.837453 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3123b8b3-e646-4872-ac46-4b85fd92ae63 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:14.837881 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3123b8b3-e646-4872-ac46-4b85fd92ae63 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:14.853244 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-93525905-4f93-413c-beaf-da5457b5e141 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-93525905-4f93-413c-beaf-da5457b5e141 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 HTTP/1.1 May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:19:14.861862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:19:14.864764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'dd44422c-b621-4ad8-82ab-e5eeae7b2633'} May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:19:14.866397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:19:14.868596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:14.870274 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-93525905-4f93-413c-beaf-da5457b5e141 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:19:14.870274 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-93525905-4f93-413c-beaf-da5457b5e141 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 404 len: 111 microversion: 2.1 time: 0.053196 May 16 15:19:14.870274 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 258/511] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:14 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:19:14.872847 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2502bcb2-417c-443c-9ba4-e3df53556f47 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '.version_select at 0x7fc9a74938b0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:14.967908 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2502bcb2-417c-443c-9ba4-e3df53556f47 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-993705601" status: 202 len: 0 microversion: 2.1 time: 0.098541 May 16 15:19:14.968417 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 259/512] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 16 15:19:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-993705601 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 15:19:14.987065 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3123b8b3-e646-4872-ac46-4b85fd92ae63 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:14.995101 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3123b8b3-e646-4872-ac46-4b85fd92ae63 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1662 microversion: 2.1 time: 0.188847 May 16 15:19:14.995833 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 254/513] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:14 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1662 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:15.209761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-335ef9d2-cd41-4189-b934-3f05648af071 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:15.210393 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-335ef9d2-cd41-4189-b934-3f05648af071 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:15.219987 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-335ef9d2-cd41-4189-b934-3f05648af071 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:15.220444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-335ef9d2-cd41-4189-b934-3f05648af071 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:15.221267 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-335ef9d2-cd41-4189-b934-3f05648af071 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:15.221882 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-335ef9d2-cd41-4189-b934-3f05648af071 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:15.324544 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fb9cee07-08cd-468c-a683-6459ff00556d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:15.325153 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fb9cee07-08cd-468c-a683-6459ff00556d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:15.331128 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb9cee07-08cd-468c-a683-6459ff00556d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:15.331575 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb9cee07-08cd-468c-a683-6459ff00556d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:15.332340 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb9cee07-08cd-468c-a683-6459ff00556d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:15.332775 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb9cee07-08cd-468c-a683-6459ff00556d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:15.478639 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fb9cee07-08cd-468c-a683-6459ff00556d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:15.486664 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fb9cee07-08cd-468c-a683-6459ff00556d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.165989 May 16 15:19:15.488410 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 255/514] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:15 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:15.491728 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-647df53a-e6b9-47b3-aa54-5175fc081566 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:15.492325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-647df53a-e6b9-47b3-aa54-5175fc081566 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:15.498095 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-647df53a-e6b9-47b3-aa54-5175fc081566 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:15.498544 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-647df53a-e6b9-47b3-aa54-5175fc081566 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:15.499310 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-647df53a-e6b9-47b3-aa54-5175fc081566 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:15.500055 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-647df53a-e6b9-47b3-aa54-5175fc081566 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:15.544382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-335ef9d2-cd41-4189-b934-3f05648af071 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:15.553083 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-335ef9d2-cd41-4189-b934-3f05648af071 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.347105 May 16 15:19:15.553855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 260/515] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:15 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:15.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-647df53a-e6b9-47b3-aa54-5175fc081566 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:15.640569 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-647df53a-e6b9-47b3-aa54-5175fc081566 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1314 microversion: 2.1 time: 0.152386 May 16 15:19:15.641152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 256/516] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:15 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:16.012731 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b5c0990f-415a-4105-85c6-3b2d1be9a24c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:16.013475 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b5c0990f-415a-4105-85c6-3b2d1be9a24c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:16.025704 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5c0990f-415a-4105-85c6-3b2d1be9a24c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:16.026185 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5c0990f-415a-4105-85c6-3b2d1be9a24c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:16.026955 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5c0990f-415a-4105-85c6-3b2d1be9a24c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:16.027159 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b3a9bb4b-2a04-4878-a593-a71840486675 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: .version_select at 0x7fc9a6c9ee50>, body: {"keypair": {"name": "tempest-keypair-970697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB1y0m/uC2gY4Ey19DOzK+DgxCJPeOkBW4U19rzhQPm9a2Laxptd4nHzWGHEGQBnsDYj3Hnn3Mlovg3YoEfoSuUpnMPT+FVUGJNQTOoL4tnfBK6TgEwlUD8pLMF03JW1w=="}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:16.027604 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5c0990f-415a-4105-85c6-3b2d1be9a24c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:16.042246 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-b3a9bb4b-2a04-4878-a593-a71840486675 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for project d143bc5a616249a7beefc7b27962026b. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:19:16.045904 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-b3a9bb4b-2a04-4878-a593-a71840486675 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for user 44ffd5660baa40a7a3d6918cb5d31e56 and project d143bc5a616249a7beefc7b27962026b. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:19:16.155883 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b5c0990f-415a-4105-85c6-3b2d1be9a24c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:16.163563 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b5c0990f-415a-4105-85c6-3b2d1be9a24c tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1662 microversion: 2.1 time: 0.154585 May 16 15:19:16.164138 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 261/517] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:16 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:16.174746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b3a9bb4b-2a04-4878-a593-a71840486675 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.151254 May 16 15:19:16.175350 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 257/518] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 16 15:19:16 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:19:16.422676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-7ae14e80-7f65-453d-906b-ce4c8375d91e req-d521e36b-1f83-48a1-a254-6b204bb628f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360b2e08-f3cd-4e7d-b9ed-11951f9298e5", "name": "network-vif-plugged", "status": "completed", "tag": "311e02b9-6d73-4765-928b-2c32a920a727"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:16.430995 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-7ae14e80-7f65-453d-906b-ce4c8375d91e req-d521e36b-1f83-48a1-a254-6b204bb628f6 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:16.431459 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-7ae14e80-7f65-453d-906b-ce4c8375d91e req-d521e36b-1f83-48a1-a254-6b204bb628f6 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:16.442772 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-7ae14e80-7f65-453d-906b-ce4c8375d91e req-d521e36b-1f83-48a1-a254-6b204bb628f6 service nova] Creating event network-vif-plugged:311e02b9-6d73-4765-928b-2c32a920a727 for instance 360b2e08-f3cd-4e7d-b9ed-11951f9298e5 on hv-cinder-79578 May 16 15:19:16.447483 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-7ae14e80-7f65-453d-906b-ce4c8375d91e req-d521e36b-1f83-48a1-a254-6b204bb628f6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028455 May 16 15:19:16.448053 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 262/519] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:16.503804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-92a7f562-6b1c-46bb-86ba-518b9339d0e2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:16.504936 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-92a7f562-6b1c-46bb-86ba-518b9339d0e2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:16.510942 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92a7f562-6b1c-46bb-86ba-518b9339d0e2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:16.511388 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92a7f562-6b1c-46bb-86ba-518b9339d0e2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:16.512203 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92a7f562-6b1c-46bb-86ba-518b9339d0e2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:16.512637 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92a7f562-6b1c-46bb-86ba-518b9339d0e2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:16.572218 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9eb338a4-7709-4f24-8cc1-18ad171bb784 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:16.572926 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9eb338a4-7709-4f24-8cc1-18ad171bb784 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:16.581471 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eb338a4-7709-4f24-8cc1-18ad171bb784 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:16.581814 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eb338a4-7709-4f24-8cc1-18ad171bb784 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:16.583511 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eb338a4-7709-4f24-8cc1-18ad171bb784 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:16.584106 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eb338a4-7709-4f24-8cc1-18ad171bb784 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:16.669415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-92a7f562-6b1c-46bb-86ba-518b9339d0e2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:16.677282 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-92a7f562-6b1c-46bb-86ba-518b9339d0e2 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.177413 May 16 15:19:16.677866 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 258/520] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:16 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:16.682433 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-60a70eac-af7c-4537-b42b-788b350617be tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:16.683031 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-60a70eac-af7c-4537-b42b-788b350617be tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:16.689114 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60a70eac-af7c-4537-b42b-788b350617be tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:16.695838 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60a70eac-af7c-4537-b42b-788b350617be tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:16.695838 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60a70eac-af7c-4537-b42b-788b350617be tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:16.695838 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60a70eac-af7c-4537-b42b-788b350617be tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:16.768463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9eb338a4-7709-4f24-8cc1-18ad171bb784 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:16.782650 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9eb338a4-7709-4f24-8cc1-18ad171bb784 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.215690 May 16 15:19:16.785072 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 263/521] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:16 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:16.821219 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-60a70eac-af7c-4537-b42b-788b350617be tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:16.828377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-60a70eac-af7c-4537-b42b-788b350617be tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1314 microversion: 2.1 time: 0.149451 May 16 15:19:16.828945 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 259/522] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:16 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:17.181042 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6ecf797b-9d88-46f7-909a-c420943c701a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:17.181642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6ecf797b-9d88-46f7-909a-c420943c701a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:17.188303 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ecf797b-9d88-46f7-909a-c420943c701a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:17.188743 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ecf797b-9d88-46f7-909a-c420943c701a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:17.189497 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ecf797b-9d88-46f7-909a-c420943c701a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:17.189925 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ecf797b-9d88-46f7-909a-c420943c701a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:17.393099 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6ecf797b-9d88-46f7-909a-c420943c701a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:17.401040 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6ecf797b-9d88-46f7-909a-c420943c701a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1666 microversion: 2.1 time: 0.224788 May 16 15:19:17.401604 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 264/523] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:17 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1666 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:17.694861 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a95fcb00-0082-4992-b214-b9b72bb7922d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:17.695464 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a95fcb00-0082-4992-b214-b9b72bb7922d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:17.701698 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a95fcb00-0082-4992-b214-b9b72bb7922d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:17.702178 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a95fcb00-0082-4992-b214-b9b72bb7922d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:17.702943 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a95fcb00-0082-4992-b214-b9b72bb7922d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:17.703378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a95fcb00-0082-4992-b214-b9b72bb7922d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:17.800749 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aa97279b-c7c9-4eef-beaf-fb0dbe2e5e41 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:17.801392 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aa97279b-c7c9-4eef-beaf-fb0dbe2e5e41 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:17.807355 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa97279b-c7c9-4eef-beaf-fb0dbe2e5e41 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:17.807814 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa97279b-c7c9-4eef-beaf-fb0dbe2e5e41 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:17.808591 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa97279b-c7c9-4eef-beaf-fb0dbe2e5e41 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:17.809028 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa97279b-c7c9-4eef-beaf-fb0dbe2e5e41 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:17.889065 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a95fcb00-0082-4992-b214-b9b72bb7922d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:17.897772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a95fcb00-0082-4992-b214-b9b72bb7922d tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.207305 May 16 15:19:17.898390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 260/524] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:17 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:17.902857 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8e6765ea-ec34-4b00-9ace-9ad0f1a325a3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:17.903472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8e6765ea-ec34-4b00-9ace-9ad0f1a325a3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:17.909338 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e6765ea-ec34-4b00-9ace-9ad0f1a325a3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:17.913919 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e6765ea-ec34-4b00-9ace-9ad0f1a325a3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:17.913919 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e6765ea-ec34-4b00-9ace-9ad0f1a325a3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:17.913919 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e6765ea-ec34-4b00-9ace-9ad0f1a325a3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:17.945514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aa97279b-c7c9-4eef-beaf-fb0dbe2e5e41 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:17.953450 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aa97279b-c7c9-4eef-beaf-fb0dbe2e5e41 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.156521 May 16 15:19:17.956609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 265/525] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:17 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:18.123687 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8e6765ea-ec34-4b00-9ace-9ad0f1a325a3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:18.131772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8e6765ea-ec34-4b00-9ace-9ad0f1a325a3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1314 microversion: 2.1 time: 0.232363 May 16 15:19:18.132336 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 261/526] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:17 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:18.803947 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-486464038", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "982c6e92-7848-46dd-811d-5ec569a6da67"}], "security_groups": [{"name": "tempest-securitygroup--1283731030"}], "key_name": "tempest-keypair-970697", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:18.901420 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] validate_networks() for [('982c6e92-7848-46dd-811d-5ec569a6da67', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:19:18.915381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-eea686da-00aa-4b5e-87a7-cdd003589320 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:18.916120 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-eea686da-00aa-4b5e-87a7-cdd003589320 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:18.922493 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eea686da-00aa-4b5e-87a7-cdd003589320 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:18.927168 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eea686da-00aa-4b5e-87a7-cdd003589320 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:18.927168 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eea686da-00aa-4b5e-87a7-cdd003589320 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:18.927168 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eea686da-00aa-4b5e-87a7-cdd003589320 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.074810 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-eea686da-00aa-4b5e-87a7-cdd003589320 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:19.084024 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-eea686da-00aa-4b5e-87a7-cdd003589320 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.172317 May 16 15:19:19.084604 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 262/527] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:18 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:19.089042 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-916b488a-1726-40e1-ab53-a741330c54fc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:19.089638 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-916b488a-1726-40e1-ab53-a741330c54fc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:19.097970 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-916b488a-1726-40e1-ab53-a741330c54fc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.098487 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-916b488a-1726-40e1-ab53-a741330c54fc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.099272 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-916b488a-1726-40e1-ab53-a741330c54fc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.099706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-916b488a-1726-40e1-ab53-a741330c54fc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.228891 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-916b488a-1726-40e1-ab53-a741330c54fc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:19.236744 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-916b488a-1726-40e1-ab53-a741330c54fc tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.151202 May 16 15:19:19.237310 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 263/528] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:19 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:19.242501 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6a90c74f-dddf-4c7f-ab31-fa03f94afa58 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:19.243309 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6a90c74f-dddf-4c7f-ab31-fa03f94afa58 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:19.249010 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a90c74f-dddf-4c7f-ab31-fa03f94afa58 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.249451 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a90c74f-dddf-4c7f-ab31-fa03f94afa58 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.250234 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a90c74f-dddf-4c7f-ab31-fa03f94afa58 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.250663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a90c74f-dddf-4c7f-ab31-fa03f94afa58 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.274524 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:19:19.274967 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:19:19.275478 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:19:19.275912 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:19:19.276462 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:19:19.287482 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.288233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.289044 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.289480 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.309329 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for project d143bc5a616249a7beefc7b27962026b. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:19:19.313659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for user 44ffd5660baa40a7a3d6918cb5d31e56 and project d143bc5a616249a7beefc7b27962026b. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:19:19.325042 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:19:19.327301 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:19:19.381557 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6a90c74f-dddf-4c7f-ab31-fa03f94afa58 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:19.388967 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6a90c74f-dddf-4c7f-ab31-fa03f94afa58 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1464 microversion: 2.1 time: 0.150576 May 16 15:19:19.389531 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 264/529] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:19 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:19.427446 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-00302f06-0af1-47ba-8a32-94750b0d6db6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:19.427937 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-00302f06-0af1-47ba-8a32-94750b0d6db6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:19.433816 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-00302f06-0af1-47ba-8a32-94750b0d6db6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.434296 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-00302f06-0af1-47ba-8a32-94750b0d6db6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.435053 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-00302f06-0af1-47ba-8a32-94750b0d6db6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.435486 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-00302f06-0af1-47ba-8a32-94750b0d6db6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.458915 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d9e0117c-3ee6-4fe8-a944-c4bf32c6ef80 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.659453 May 16 15:19:19.459743 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 266/530] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:19:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:19:19.459880 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-00302f06-0af1-47ba-8a32-94750b0d6db6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:19:19.469476 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-63b5c47b-6207-4778-844b-23b071ef0caa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:19.470092 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-63b5c47b-6207-4778-844b-23b071ef0caa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:19.540810 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-63b5c47b-6207-4778-844b-23b071ef0caa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:19.549060 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-63b5c47b-6207-4778-844b-23b071ef0caa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1237 microversion: 2.1 time: 0.083340 May 16 15:19:19.549615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 267/531] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:19 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:19.754847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-00302f06-0af1-47ba-8a32-94750b0d6db6 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "DELETE /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 204 len: 0 microversion: 2.1 time: 0.330784 May 16 15:19:19.755634 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 265/532] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:19:19 2022] DELETE /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 15:19:19.763544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7de20030-1d43-47ff-8630-d027933c6698 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:19.764181 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7de20030-1d43-47ff-8630-d027933c6698 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:19.770143 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7de20030-1d43-47ff-8630-d027933c6698 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.770594 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7de20030-1d43-47ff-8630-d027933c6698 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.771369 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7de20030-1d43-47ff-8630-d027933c6698 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.771802 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7de20030-1d43-47ff-8630-d027933c6698 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.903840 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7de20030-1d43-47ff-8630-d027933c6698 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:19.911841 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7de20030-1d43-47ff-8630-d027933c6698 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1470 microversion: 2.1 time: 0.152169 May 16 15:19:19.912418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 268/533] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:19 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:20.101753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d222290f-6294-4e85-bd88-1f7e26f4c8d7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:20.102499 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d222290f-6294-4e85-bd88-1f7e26f4c8d7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:20.108797 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d222290f-6294-4e85-bd88-1f7e26f4c8d7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.109248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d222290f-6294-4e85-bd88-1f7e26f4c8d7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:20.110015 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d222290f-6294-4e85-bd88-1f7e26f4c8d7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.110481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d222290f-6294-4e85-bd88-1f7e26f4c8d7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:20.254351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b4413877-eed4-46fa-a23d-6b9c1b7496ab tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:20.254796 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d222290f-6294-4e85-bd88-1f7e26f4c8d7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:20.254991 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b4413877-eed4-46fa-a23d-6b9c1b7496ab tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:20.261160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4413877-eed4-46fa-a23d-6b9c1b7496ab tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.261612 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4413877-eed4-46fa-a23d-6b9c1b7496ab tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:20.262443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4413877-eed4-46fa-a23d-6b9c1b7496ab tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.262886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4413877-eed4-46fa-a23d-6b9c1b7496ab tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:20.263075 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d222290f-6294-4e85-bd88-1f7e26f4c8d7 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.165903 May 16 15:19:20.263722 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 266/534] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:20 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:20.567164 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-816433e2-9b61-47d4-83c8-962f63d35f5e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:20.567776 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-816433e2-9b61-47d4-83c8-962f63d35f5e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:20.573748 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-816433e2-9b61-47d4-83c8-962f63d35f5e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.574243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-816433e2-9b61-47d4-83c8-962f63d35f5e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:20.575013 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-816433e2-9b61-47d4-83c8-962f63d35f5e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.575444 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-816433e2-9b61-47d4-83c8-962f63d35f5e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:20.611921 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b4413877-eed4-46fa-a23d-6b9c1b7496ab tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:20.619856 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b4413877-eed4-46fa-a23d-6b9c1b7496ab tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.369358 May 16 15:19:20.620433 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 269/535] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:20 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:20.636952 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-816433e2-9b61-47d4-83c8-962f63d35f5e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:20.644129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-816433e2-9b61-47d4-83c8-962f63d35f5e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1241 microversion: 2.1 time: 0.080783 May 16 15:19:20.644727 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 267/536] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:20 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:20.929253 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9688322b-bdb4-46de-ba2d-99b52296b3b7 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:20.929770 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9688322b-bdb4-46de-ba2d-99b52296b3b7 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:20.936123 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9688322b-bdb4-46de-ba2d-99b52296b3b7 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.936567 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9688322b-bdb4-46de-ba2d-99b52296b3b7 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:20.937575 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9688322b-bdb4-46de-ba2d-99b52296b3b7 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.938017 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9688322b-bdb4-46de-ba2d-99b52296b3b7 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:21.067771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9688322b-bdb4-46de-ba2d-99b52296b3b7 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:21.075479 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9688322b-bdb4-46de-ba2d-99b52296b3b7 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1470 microversion: 2.1 time: 0.150434 May 16 15:19:21.076389 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 270/537] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:20 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:21.280806 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6a9d8975-25cb-41da-a6ab-b2404d0a741f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:21.281351 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6a9d8975-25cb-41da-a6ab-b2404d0a741f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:21.288402 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a9d8975-25cb-41da-a6ab-b2404d0a741f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:21.288853 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a9d8975-25cb-41da-a6ab-b2404d0a741f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:21.289751 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a9d8975-25cb-41da-a6ab-b2404d0a741f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:21.290285 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a9d8975-25cb-41da-a6ab-b2404d0a741f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:21.434493 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6a9d8975-25cb-41da-a6ab-b2404d0a741f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:21.443574 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6a9d8975-25cb-41da-a6ab-b2404d0a741f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.166502 May 16 15:19:21.444179 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 268/538] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:21 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:21.637512 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ee12176c-0dab-44ee-a080-05b89503a6b9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:21.638299 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ee12176c-0dab-44ee-a080-05b89503a6b9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:21.644428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee12176c-0dab-44ee-a080-05b89503a6b9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:21.645576 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee12176c-0dab-44ee-a080-05b89503a6b9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:21.646448 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee12176c-0dab-44ee-a080-05b89503a6b9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:21.646949 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee12176c-0dab-44ee-a080-05b89503a6b9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:21.660690 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a9d93edb-80a1-4482-ad22-da485bfb7994 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:21.664615 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a9d93edb-80a1-4482-ad22-da485bfb7994 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:21.670988 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a9d93edb-80a1-4482-ad22-da485bfb7994 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:21.671586 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a9d93edb-80a1-4482-ad22-da485bfb7994 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:21.672367 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a9d93edb-80a1-4482-ad22-da485bfb7994 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:21.672846 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a9d93edb-80a1-4482-ad22-da485bfb7994 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:21.736811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a9d93edb-80a1-4482-ad22-da485bfb7994 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:21.744465 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a9d93edb-80a1-4482-ad22-da485bfb7994 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1289 microversion: 2.1 time: 0.087749 May 16 15:19:21.745342 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 269/539] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:21 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:21.832296 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee12176c-0dab-44ee-a080-05b89503a6b9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:21.840308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ee12176c-0dab-44ee-a080-05b89503a6b9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.206718 May 16 15:19:21.840881 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 271/540] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:21 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:21.976899 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-85040e78-4bad-4718-969c-4f5b454edca8 req-d788ca58-428e-4b07-87bc-b5630561317a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360b2e08-f3cd-4e7d-b9ed-11951f9298e5", "name": "network-vif-deleted", "tag": "311e02b9-6d73-4765-928b-2c32a920a727"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:21.985310 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-85040e78-4bad-4718-969c-4f5b454edca8 req-d788ca58-428e-4b07-87bc-b5630561317a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:21.985757 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-85040e78-4bad-4718-969c-4f5b454edca8 req-d788ca58-428e-4b07-87bc-b5630561317a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:21.997686 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-85040e78-4bad-4718-969c-4f5b454edca8 req-d788ca58-428e-4b07-87bc-b5630561317a service nova] Creating event network-vif-deleted:311e02b9-6d73-4765-928b-2c32a920a727 for instance 360b2e08-f3cd-4e7d-b9ed-11951f9298e5 on hv-cinder-79578 May 16 15:19:22.007700 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-85040e78-4bad-4718-969c-4f5b454edca8 req-d788ca58-428e-4b07-87bc-b5630561317a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034804 May 16 15:19:22.008301 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 270/541] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:22.093006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e9a3aace-b028-4ee8-be92-f54497ec8277 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:22.093649 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e9a3aace-b028-4ee8-be92-f54497ec8277 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:22.100298 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9a3aace-b028-4ee8-be92-f54497ec8277 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:22.100751 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9a3aace-b028-4ee8-be92-f54497ec8277 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:22.101530 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9a3aace-b028-4ee8-be92-f54497ec8277 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:22.102021 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9a3aace-b028-4ee8-be92-f54497ec8277 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:22.165026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e9a3aace-b028-4ee8-be92-f54497ec8277 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afa342faf7484a9ffb830db20d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a81cdda2b24d85a96f06585868e8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:22.172550 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e9a3aace-b028-4ee8-be92-f54497ec8277 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 200 len: 1428 microversion: 2.1 time: 0.083626 May 16 15:19:22.173116 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 272/542] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:22 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:22.461698 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7b0f5b37-1ddc-4a3c-99b7-5dd7553710b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:22.463267 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7b0f5b37-1ddc-4a3c-99b7-5dd7553710b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:22.469927 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7b0f5b37-1ddc-4a3c-99b7-5dd7553710b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:22.470603 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7b0f5b37-1ddc-4a3c-99b7-5dd7553710b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:22.471643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7b0f5b37-1ddc-4a3c-99b7-5dd7553710b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:22.472231 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7b0f5b37-1ddc-4a3c-99b7-5dd7553710b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:22.617125 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7b0f5b37-1ddc-4a3c-99b7-5dd7553710b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:22.625425 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7b0f5b37-1ddc-4a3c-99b7-5dd7553710b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.168280 May 16 15:19:22.625930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 271/543] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:22 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:22.761196 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8419cdc1-5f37-4ca2-b9be-051ac257143d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:22.763360 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8419cdc1-5f37-4ca2-b9be-051ac257143d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:22.767891 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8419cdc1-5f37-4ca2-b9be-051ac257143d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:22.768343 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8419cdc1-5f37-4ca2-b9be-051ac257143d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:22.769140 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8419cdc1-5f37-4ca2-b9be-051ac257143d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:22.769581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8419cdc1-5f37-4ca2-b9be-051ac257143d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:22.849674 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8419cdc1-5f37-4ca2-b9be-051ac257143d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:22.853829 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8419cdc1-5f37-4ca2-b9be-051ac257143d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1295 microversion: 2.1 time: 0.096613 May 16 15:19:22.854459 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 273/544] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:22 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:22.857109 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9ed2925b-ea65-4408-b78e-ff11e96b9dc9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:22.858521 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9ed2925b-ea65-4408-b78e-ff11e96b9dc9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:22.865299 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ed2925b-ea65-4408-b78e-ff11e96b9dc9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:22.865708 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ed2925b-ea65-4408-b78e-ff11e96b9dc9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:22.866586 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ed2925b-ea65-4408-b78e-ff11e96b9dc9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:22.867008 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ed2925b-ea65-4408-b78e-ff11e96b9dc9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:22.998774 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9ed2925b-ea65-4408-b78e-ff11e96b9dc9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:23.007693 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9ed2925b-ea65-4408-b78e-ff11e96b9dc9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.154733 May 16 15:19:23.008282 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 272/545] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:22 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:23.199307 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2a4c7234-de6f-47d4-b032-488f5a3eeda3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:23.199937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2a4c7234-de6f-47d4-b032-488f5a3eeda3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] [instance: 360b2e08-f3cd-4e7d-b9ed-11951f9298e5] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:23.207127 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a4c7234-de6f-47d4-b032-488f5a3eeda3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:23.208292 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a4c7234-de6f-47d4-b032-488f5a3eeda3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:23.208461 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a4c7234-de6f-47d4-b032-488f5a3eeda3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:23.208808 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a4c7234-de6f-47d4-b032-488f5a3eeda3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:23.223685 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-2a4c7234-de6f-47d4-b032-488f5a3eeda3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] HTTP exception thrown: Instance 360b2e08-f3cd-4e7d-b9ed-11951f9298e5 could not be found. May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2a4c7234-de6f-47d4-b032-488f5a3eeda3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Request method failure captured: May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 HTTP/1.1 May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmtlk8QVCecLZVPrmBn7Mbzk1HZR-1b-ZknhxP3cgE0YQJNttfLWEgWKw1LRSYktliNXZzWUojnxB92_oAVLQ53MteakQ_f9oK8lqlcm6wvd14yZ6mkzZryHi7FMOtn_rK8pn8kXoT2HiEAUvbJZP-So24_yAirllqu-IySXex5FTd0 May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: a7a81cdda2b24d85a96f06585868e8f9 May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesNegativeTest-1133038861 May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:19:23.225380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7a81cdda2b24d85a96f06585868e8f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a7a81cdda2b24d85a96f06585868e8f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7a81cdda2b24d85a96f06585868e8f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a7a81cdda2b24d85a96f06585868e8f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesNegativeTest-1133038861 May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: a7a81cdda2b24d85a96f06585868e8f9 May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesNegativeTest-1133038861 May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesNegativeTest-1133038861-project May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 94afa342faf7484a9ffb830db20d24d4 May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesNegativeTest-1133038861-project May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance 360b2e08-f3cd-4e7d-b9ed-11951f9298e5 could not be found. May 16 15:19:23.227125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '360b2e08-f3cd-4e7d-b9ed-11951f9298e5'} May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360b2e08-f3cd-4e7d-b9ed-11951f9298e5 could not be found. May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:19:23.228686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360b2e08-f3cd-4e7d-b9ed-11951f9298e5 could not be found. May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360b2e08-f3cd-4e7d-b9ed-11951f9298e5 could not be found. May 16 15:19:23.230761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:23.231827 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2a4c7234-de6f-47d4-b032-488f5a3eeda3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] Returning 404 to user: Instance 360b2e08-f3cd-4e7d-b9ed-11951f9298e5 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:19:23.231827 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2a4c7234-de6f-47d4-b032-488f5a3eeda3 tempest-VolumesNegativeTest-1133038861 tempest-VolumesNegativeTest-1133038861-project] 10.222.0.44 "GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5" status: 404 len: 111 microversion: 2.1 time: 0.031729 May 16 15:19:23.231827 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 274/546] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:23 2022] GET /compute/v2.1/servers/360b2e08-f3cd-4e7d-b9ed-11951f9298e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:19:23.643351 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fad0f0a5-45e0-46f2-a233-7b53d78ba404 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:23.647961 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fad0f0a5-45e0-46f2-a233-7b53d78ba404 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:23.651011 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fad0f0a5-45e0-46f2-a233-7b53d78ba404 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:23.651453 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fad0f0a5-45e0-46f2-a233-7b53d78ba404 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:23.652212 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fad0f0a5-45e0-46f2-a233-7b53d78ba404 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:23.652640 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fad0f0a5-45e0-46f2-a233-7b53d78ba404 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:23.812056 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fad0f0a5-45e0-46f2-a233-7b53d78ba404 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:23.822282 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fad0f0a5-45e0-46f2-a233-7b53d78ba404 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1757 microversion: 2.1 time: 0.182799 May 16 15:19:23.823131 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 273/547] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:23 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:23.871613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0ce31bb3-e53c-4f8a-a8a1-16b6eb041591 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:23.872229 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0ce31bb3-e53c-4f8a-a8a1-16b6eb041591 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:23.879443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ce31bb3-e53c-4f8a-a8a1-16b6eb041591 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:23.879889 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ce31bb3-e53c-4f8a-a8a1-16b6eb041591 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:23.880854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ce31bb3-e53c-4f8a-a8a1-16b6eb041591 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:23.881291 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ce31bb3-e53c-4f8a-a8a1-16b6eb041591 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:24.024741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3066a5f7-0c82-40cd-8351-238e0aa7f6f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:24.025351 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3066a5f7-0c82-40cd-8351-238e0aa7f6f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:24.031322 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3066a5f7-0c82-40cd-8351-238e0aa7f6f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:24.037973 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3066a5f7-0c82-40cd-8351-238e0aa7f6f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:24.037973 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3066a5f7-0c82-40cd-8351-238e0aa7f6f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:24.037973 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3066a5f7-0c82-40cd-8351-238e0aa7f6f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:24.055426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0ce31bb3-e53c-4f8a-a8a1-16b6eb041591 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:24.063094 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0ce31bb3-e53c-4f8a-a8a1-16b6eb041591 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1363 microversion: 2.1 time: 0.195362 May 16 15:19:24.063668 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 275/548] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:23 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:24.166094 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-ee5c469c-13f1-407e-9f24-0f05e4c57928 req-104c51a4-670e-4a15-a0f5-4c69fc06d476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7914c5a4-73f7-4114-a4ec-d583fecff5ec", "tag": "c65d1e07-7d92-45c0-afcb-735f16828214"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:24.174546 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ee5c469c-13f1-407e-9f24-0f05e4c57928 req-104c51a4-670e-4a15-a0f5-4c69fc06d476 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:24.175212 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ee5c469c-13f1-407e-9f24-0f05e4c57928 req-104c51a4-670e-4a15-a0f5-4c69fc06d476 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:24.180070 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3066a5f7-0c82-40cd-8351-238e0aa7f6f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:24.196830 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3066a5f7-0c82-40cd-8351-238e0aa7f6f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.175755 May 16 15:19:24.206714 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 274/549] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:24 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:24.215168 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-ee5c469c-13f1-407e-9f24-0f05e4c57928 req-104c51a4-670e-4a15-a0f5-4c69fc06d476 service nova] Creating event network-changed:c65d1e07-7d92-45c0-afcb-735f16828214 for instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec on hv-cinder-79578 May 16 15:19:24.219879 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-ee5c469c-13f1-407e-9f24-0f05e4c57928 req-104c51a4-670e-4a15-a0f5-4c69fc06d476 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057708 May 16 15:19:24.220477 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 276/550] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:24.839284 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-434b1727-b5ae-40d2-b759-9f8ce4832e49 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:24.839924 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-434b1727-b5ae-40d2-b759-9f8ce4832e49 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:24.846313 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-434b1727-b5ae-40d2-b759-9f8ce4832e49 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:24.846763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-434b1727-b5ae-40d2-b759-9f8ce4832e49 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:24.848217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-434b1727-b5ae-40d2-b759-9f8ce4832e49 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:24.848651 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-434b1727-b5ae-40d2-b759-9f8ce4832e49 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:24.990808 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-434b1727-b5ae-40d2-b759-9f8ce4832e49 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:24.999043 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-434b1727-b5ae-40d2-b759-9f8ce4832e49 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1760 microversion: 2.1 time: 0.163551 May 16 15:19:24.999622 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 275/551] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:24 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:25.083448 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d4d0e55e-6461-4b4e-861e-b6c073914508 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:25.084205 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d4d0e55e-6461-4b4e-861e-b6c073914508 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:25.090277 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4d0e55e-6461-4b4e-861e-b6c073914508 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:25.090725 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4d0e55e-6461-4b4e-861e-b6c073914508 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:25.091502 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4d0e55e-6461-4b4e-861e-b6c073914508 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:25.091941 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4d0e55e-6461-4b4e-861e-b6c073914508 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:25.217136 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cfa6f043-b092-4b17-8632-c2f5df51f007 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:25.218300 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cfa6f043-b092-4b17-8632-c2f5df51f007 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:25.224358 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cfa6f043-b092-4b17-8632-c2f5df51f007 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:25.224889 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cfa6f043-b092-4b17-8632-c2f5df51f007 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:25.225745 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cfa6f043-b092-4b17-8632-c2f5df51f007 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:25.226442 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cfa6f043-b092-4b17-8632-c2f5df51f007 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:25.312663 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d4d0e55e-6461-4b4e-861e-b6c073914508 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:25.321012 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d4d0e55e-6461-4b4e-861e-b6c073914508 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1363 microversion: 2.1 time: 0.245064 May 16 15:19:25.327085 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 277/552] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:25 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:25.367834 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cfa6f043-b092-4b17-8632-c2f5df51f007 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:25.376025 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cfa6f043-b092-4b17-8632-c2f5df51f007 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.165902 May 16 15:19:25.376600 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 276/553] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:25 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:26.343311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7ff81af8-9e36-48d3-9c1b-4f7b79839f8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:26.343920 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7ff81af8-9e36-48d3-9c1b-4f7b79839f8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:26.351355 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ff81af8-9e36-48d3-9c1b-4f7b79839f8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:26.351801 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ff81af8-9e36-48d3-9c1b-4f7b79839f8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:26.352612 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ff81af8-9e36-48d3-9c1b-4f7b79839f8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:26.353045 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ff81af8-9e36-48d3-9c1b-4f7b79839f8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:26.392991 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-30b24d8d-55ec-460a-a281-efce8519049f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:26.394001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-30b24d8d-55ec-460a-a281-efce8519049f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:26.401285 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-30b24d8d-55ec-460a-a281-efce8519049f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:26.401860 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-30b24d8d-55ec-460a-a281-efce8519049f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:26.402763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-30b24d8d-55ec-460a-a281-efce8519049f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:26.403532 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-30b24d8d-55ec-460a-a281-efce8519049f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:26.511759 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7ff81af8-9e36-48d3-9c1b-4f7b79839f8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:26.515390 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7ff81af8-9e36-48d3-9c1b-4f7b79839f8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1363 microversion: 2.1 time: 0.175880 May 16 15:19:26.516804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 278/554] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:26 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:26.552192 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-30b24d8d-55ec-460a-a281-efce8519049f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:26.560262 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-30b24d8d-55ec-460a-a281-efce8519049f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.171362 May 16 15:19:26.560829 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 277/555] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:26 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:27.532910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f703d3c0-d6e1-4240-b1fd-a32044969df7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:27.533477 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f703d3c0-d6e1-4240-b1fd-a32044969df7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:27.541244 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f703d3c0-d6e1-4240-b1fd-a32044969df7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:27.541691 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f703d3c0-d6e1-4240-b1fd-a32044969df7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:27.542495 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f703d3c0-d6e1-4240-b1fd-a32044969df7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:27.542934 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f703d3c0-d6e1-4240-b1fd-a32044969df7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:27.576741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9eccbd36-96d0-4580-a593-cf41f36abf80 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:27.592549 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9eccbd36-96d0-4580-a593-cf41f36abf80 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:27.592549 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9eccbd36-96d0-4580-a593-cf41f36abf80 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:27.592549 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9eccbd36-96d0-4580-a593-cf41f36abf80 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:27.592549 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9eccbd36-96d0-4580-a593-cf41f36abf80 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:27.593971 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9eccbd36-96d0-4580-a593-cf41f36abf80 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:27.676543 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f703d3c0-d6e1-4240-b1fd-a32044969df7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:27.683826 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f703d3c0-d6e1-4240-b1fd-a32044969df7 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1363 microversion: 2.1 time: 0.154872 May 16 15:19:27.684395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 279/556] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:27 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:27.717251 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9eccbd36-96d0-4580-a593-cf41f36abf80 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:27.725141 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9eccbd36-96d0-4580-a593-cf41f36abf80 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.152249 May 16 15:19:27.725717 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 278/557] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:27 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:28.700555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2d1a557b-b9b0-497f-b89d-78a29cdc2c88 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:28.701153 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2d1a557b-b9b0-497f-b89d-78a29cdc2c88 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:28.707437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d1a557b-b9b0-497f-b89d-78a29cdc2c88 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:28.708374 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d1a557b-b9b0-497f-b89d-78a29cdc2c88 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:28.709130 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d1a557b-b9b0-497f-b89d-78a29cdc2c88 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:28.709554 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d1a557b-b9b0-497f-b89d-78a29cdc2c88 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:28.743340 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-09e721f9-e454-4f93-8161-839012aef4ee tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:28.743982 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-09e721f9-e454-4f93-8161-839012aef4ee tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:28.751763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09e721f9-e454-4f93-8161-839012aef4ee tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:28.752162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09e721f9-e454-4f93-8161-839012aef4ee tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:28.752935 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09e721f9-e454-4f93-8161-839012aef4ee tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:28.753374 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09e721f9-e454-4f93-8161-839012aef4ee tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:28.843633 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2d1a557b-b9b0-497f-b89d-78a29cdc2c88 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:28.851995 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2d1a557b-b9b0-497f-b89d-78a29cdc2c88 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1363 microversion: 2.1 time: 0.155137 May 16 15:19:28.852685 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 280/558] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:28 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:28.896368 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-09e721f9-e454-4f93-8161-839012aef4ee tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:28.906407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-09e721f9-e454-4f93-8161-839012aef4ee tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.166201 May 16 15:19:28.906407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 279/559] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:28 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:29.874445 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-121a9721-192c-4116-8699-5a61611ee5aa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:29.875341 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-121a9721-192c-4116-8699-5a61611ee5aa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:29.882263 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-121a9721-192c-4116-8699-5a61611ee5aa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:29.883338 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-121a9721-192c-4116-8699-5a61611ee5aa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:29.883533 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-121a9721-192c-4116-8699-5a61611ee5aa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:29.883939 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-121a9721-192c-4116-8699-5a61611ee5aa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:29.921272 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7e0eb677-a268-4fe5-ba15-ca8b71361fd3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:29.921989 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7e0eb677-a268-4fe5-ba15-ca8b71361fd3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:29.928520 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7e0eb677-a268-4fe5-ba15-ca8b71361fd3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:29.929124 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7e0eb677-a268-4fe5-ba15-ca8b71361fd3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:29.929945 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7e0eb677-a268-4fe5-ba15-ca8b71361fd3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:29.930472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7e0eb677-a268-4fe5-ba15-ca8b71361fd3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:30.015210 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-121a9721-192c-4116-8699-5a61611ee5aa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:30.022859 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-121a9721-192c-4116-8699-5a61611ee5aa tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1363 microversion: 2.1 time: 0.152210 May 16 15:19:30.023438 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 281/560] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:29 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:30.070214 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7e0eb677-a268-4fe5-ba15-ca8b71361fd3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:30.078502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7e0eb677-a268-4fe5-ba15-ca8b71361fd3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.160955 May 16 15:19:30.079070 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 280/561] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:29 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:30.465999 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-f23a1511-e556-4cc9-bdc1-070548cc6fd5 req-6c0df707-a533-49f4-9e5f-98e53d476156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7914c5a4-73f7-4114-a4ec-d583fecff5ec", "name": "network-vif-plugged", "status": "completed", "tag": "c65d1e07-7d92-45c0-afcb-735f16828214"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:30.475737 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-f23a1511-e556-4cc9-bdc1-070548cc6fd5 req-6c0df707-a533-49f4-9e5f-98e53d476156 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:30.476253 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-f23a1511-e556-4cc9-bdc1-070548cc6fd5 req-6c0df707-a533-49f4-9e5f-98e53d476156 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:30.487064 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-f23a1511-e556-4cc9-bdc1-070548cc6fd5 req-6c0df707-a533-49f4-9e5f-98e53d476156 service nova] Creating event network-vif-plugged:c65d1e07-7d92-45c0-afcb-735f16828214 for instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec on hv-cinder-79578 May 16 15:19:30.492783 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-f23a1511-e556-4cc9-bdc1-070548cc6fd5 req-6c0df707-a533-49f4-9e5f-98e53d476156 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030494 May 16 15:19:30.493384 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 282/562] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:31.039917 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dd28ac58-50a5-4294-b980-b9893664ac81 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:31.040530 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dd28ac58-50a5-4294-b980-b9893664ac81 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:31.047017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dd28ac58-50a5-4294-b980-b9893664ac81 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:31.047474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dd28ac58-50a5-4294-b980-b9893664ac81 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:31.048318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dd28ac58-50a5-4294-b980-b9893664ac81 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:31.048758 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dd28ac58-50a5-4294-b980-b9893664ac81 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:31.095901 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-beb0c1a8-d8ad-4c7a-8bef-440b9918de2e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:31.096653 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-beb0c1a8-d8ad-4c7a-8bef-440b9918de2e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:31.106007 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-beb0c1a8-d8ad-4c7a-8bef-440b9918de2e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:31.106756 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-beb0c1a8-d8ad-4c7a-8bef-440b9918de2e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:31.107860 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-beb0c1a8-d8ad-4c7a-8bef-440b9918de2e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:31.108443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-beb0c1a8-d8ad-4c7a-8bef-440b9918de2e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:31.244149 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-beb0c1a8-d8ad-4c7a-8bef-440b9918de2e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:31.244840 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-dd28ac58-50a5-4294-b980-b9893664ac81 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:31.251938 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dd28ac58-50a5-4294-b980-b9893664ac81 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1363 microversion: 2.1 time: 0.216280 May 16 15:19:31.252640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-beb0c1a8-d8ad-4c7a-8bef-440b9918de2e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.161062 May 16 15:19:31.252831 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 281/563] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:31 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:31.253214 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 283/564] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:31 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:32.267673 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b7ec36c3-b6a7-4623-a039-0a8cccac27f9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:32.268325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b7ec36c3-b6a7-4623-a039-0a8cccac27f9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:32.268910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7e496cc9-5414-4bb1-aee3-b92743f775b6 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:32.269580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7e496cc9-5414-4bb1-aee3-b92743f775b6 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:32.274856 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7ec36c3-b6a7-4623-a039-0a8cccac27f9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:32.275300 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7ec36c3-b6a7-4623-a039-0a8cccac27f9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:32.275829 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e496cc9-5414-4bb1-aee3-b92743f775b6 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:32.276155 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7ec36c3-b6a7-4623-a039-0a8cccac27f9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:32.276391 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e496cc9-5414-4bb1-aee3-b92743f775b6 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:32.276544 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7ec36c3-b6a7-4623-a039-0a8cccac27f9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:32.277160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e496cc9-5414-4bb1-aee3-b92743f775b6 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:32.277595 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e496cc9-5414-4bb1-aee3-b92743f775b6 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:32.406015 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b7ec36c3-b6a7-4623-a039-0a8cccac27f9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:32.411915 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7e496cc9-5414-4bb1-aee3-b92743f775b6 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:32.414190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b7ec36c3-b6a7-4623-a039-0a8cccac27f9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1363 microversion: 2.1 time: 0.150448 May 16 15:19:32.418101 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 282/565] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:32 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:32.420056 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7e496cc9-5414-4bb1-aee3-b92743f775b6 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.154916 May 16 15:19:32.420610 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 284/566] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:32 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:33.431352 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8404ce24-2126-414d-9019-2e884f009b8b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:33.431869 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8404ce24-2126-414d-9019-2e884f009b8b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:33.438730 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8404ce24-2126-414d-9019-2e884f009b8b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:33.438924 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-91b7321c-c426-4e32-a492-b2a5d317b47e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:33.439381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8404ce24-2126-414d-9019-2e884f009b8b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:33.439543 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-91b7321c-c426-4e32-a492-b2a5d317b47e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:33.440243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8404ce24-2126-414d-9019-2e884f009b8b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:33.440685 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8404ce24-2126-414d-9019-2e884f009b8b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:33.446076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91b7321c-c426-4e32-a492-b2a5d317b47e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:33.446536 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91b7321c-c426-4e32-a492-b2a5d317b47e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:33.447296 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91b7321c-c426-4e32-a492-b2a5d317b47e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:33.447725 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91b7321c-c426-4e32-a492-b2a5d317b47e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:33.576008 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8404ce24-2126-414d-9019-2e884f009b8b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:33.576193 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-91b7321c-c426-4e32-a492-b2a5d317b47e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:33.583713 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8404ce24-2126-414d-9019-2e884f009b8b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1363 microversion: 2.1 time: 0.156257 May 16 15:19:33.583976 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-91b7321c-c426-4e32-a492-b2a5d317b47e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1735 microversion: 2.1 time: 0.149225 May 16 15:19:33.584279 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 283/567] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:33 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:33.584529 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 285/568] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:33 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:33.793199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-96831428", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "networks": [{"uuid": "52443307-02f5-4e57-bece-5c1fc6d7aa3e"}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:33.842451 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] validate_networks() for [('52443307-02f5-4e57-bece-5c1fc6d7aa3e', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:19:34.176810 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:19:34.177227 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:19:34.177700 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:19:34.178134 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:19:34.178543 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:19:34.187328 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:34.187771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:34.188568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:34.189000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:34.205508 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Getting quotas for project f6ec3267b0c548558b92318ec6179dca. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:19:34.209976 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Getting quotas for user d9e6e8acac7c447ba3885dcafb386050 and project f6ec3267b0c548558b92318ec6179dca. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:19:34.221292 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:19:34.224339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:19:34.332050 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-41aa041e-39f0-4d84-bee0-3b09a428a8d6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542514 May 16 15:19:34.333311 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 284/569] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:19:34.343283 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e6ed9c4e-f98d-4e34-9ee0-a700564196c2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:34.343892 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e6ed9c4e-f98d-4e34-9ee0-a700564196c2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:34.403637 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e6ed9c4e-f98d-4e34-9ee0-a700564196c2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:34.409985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e6ed9c4e-f98d-4e34-9ee0-a700564196c2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1217 microversion: 2.1 time: 0.070561 May 16 15:19:34.411399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 286/570] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:34 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:34.600342 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4403cc9c-601f-4029-975c-04f5df5f60c5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:34.600922 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e9d8cb42-b02f-4d3e-a12f-745fdbbd448a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:34.601282 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4403cc9c-601f-4029-975c-04f5df5f60c5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:34.601409 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e9d8cb42-b02f-4d3e-a12f-745fdbbd448a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:34.607058 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4403cc9c-601f-4029-975c-04f5df5f60c5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:34.607502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4403cc9c-601f-4029-975c-04f5df5f60c5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:34.608258 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4403cc9c-601f-4029-975c-04f5df5f60c5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:34.608696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4403cc9c-601f-4029-975c-04f5df5f60c5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:34.609774 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9d8cb42-b02f-4d3e-a12f-745fdbbd448a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:34.610254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9d8cb42-b02f-4d3e-a12f-745fdbbd448a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:34.611030 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9d8cb42-b02f-4d3e-a12f-745fdbbd448a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:34.611462 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9d8cb42-b02f-4d3e-a12f-745fdbbd448a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:34.742203 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4403cc9c-601f-4029-975c-04f5df5f60c5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:34.745642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e9d8cb42-b02f-4d3e-a12f-745fdbbd448a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:34.749585 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4403cc9c-601f-4029-975c-04f5df5f60c5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1554 microversion: 2.1 time: 0.153584 May 16 15:19:34.750359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 285/571] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:34 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:34.753819 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e9d8cb42-b02f-4d3e-a12f-745fdbbd448a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1715 microversion: 2.1 time: 0.157130 May 16 15:19:34.755995 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 287/572] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:34 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:34.768233 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-69ce9666-580c-48b4-a091-c5ecb84738eb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:34.768826 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-69ce9666-580c-48b4-a091-c5ecb84738eb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:34.775793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69ce9666-580c-48b4-a091-c5ecb84738eb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:34.776238 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69ce9666-580c-48b4-a091-c5ecb84738eb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:34.777009 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69ce9666-580c-48b4-a091-c5ecb84738eb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:34.777442 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69ce9666-580c-48b4-a091-c5ecb84738eb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:34.859702 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-69ce9666-580c-48b4-a091-c5ecb84738eb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095238 May 16 15:19:34.860390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 286/573] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 16 15:19:34 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:34.865050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a6ef6516-5aa2-47f3-9ff0-8a7062c3e3ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:34.865593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a6ef6516-5aa2-47f3-9ff0-8a7062c3e3ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:34.871907 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6ef6516-5aa2-47f3-9ff0-8a7062c3e3ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:34.872349 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6ef6516-5aa2-47f3-9ff0-8a7062c3e3ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:34.873300 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6ef6516-5aa2-47f3-9ff0-8a7062c3e3ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:34.873576 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6ef6516-5aa2-47f3-9ff0-8a7062c3e3ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:35.012862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-a6ef6516-5aa2-47f3-9ff0-8a7062c3e3ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] HTTP exception thrown: Cannot 'detach_volume' instance f78dee55-4357-4bb4-8057-ddecdd7326f6 while it is in vm_state rescued May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a6ef6516-5aa2-47f3-9ff0-8a7062c3e3ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Request method failure captured: May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments/0632c8ba-912c-4809-bfb6-faaf605c405d HTTP/1.1 May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqK54J41Q5ZxL_QyU-Q-VZdGq9UCScERyQ6w5yYqjVfeWLE0oqK7Gtv2tI5XRhcO1owfgkx6gaoy5Peo_zqyhv_hAxXy3uv_aE0iP8V5OUb4aJoKYMnErP71VH-vqCJkoqC0-9pCtMo-qvAEAPKOEkdMYHcMu8OjF3oWoy4aipwXlQ May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 316917d7a31645bfaac651f81154c18f May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:19:35.014514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:19:35.041437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/316917d7a31645bfaac651f81154c18f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/316917d7a31645bfaac651f81154c18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/316917d7a31645bfaac651f81154c18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_316917d7a31645bfaac651f81154c18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:19:35.041437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:19:35.041437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 316917d7a31645bfaac651f81154c18f May 16 15:19:35.041437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:19:35.041437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-ServerRescueNegativeTestJSON-1789909565-project May 16 15:19:35.041437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:19:35.041437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:19:35.041437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: a14795cb97ac44b2a7fc1e2f79b12253 May 16 15:19:35.041437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1789909565-project May 16 15:19:35.041437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:19:35.041437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Cannot 'detach_volume' instance f78dee55-4357-4bb4-8057-ddecdd7326f6 while it is in vm_state rescued May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'server_id': 'f78dee55-4357-4bb4-8057-ddecdd7326f6', 'id': '0632c8ba-912c-4809-bfb6-faaf605c405d'} May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f78dee55-4357-4bb4-8057-ddecdd7326f6 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:19:35.042609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f78dee55-4357-4bb4-8057-ddecdd7326f6 while it is in vm_state rescued May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f78dee55-4357-4bb4-8057-ddecdd7326f6 while it is in vm_state rescued May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:19:35.044165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a6ef6516-5aa2-47f3-9ff0-8a7062c3e3ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Returning 409 to user: Cannot 'detach_volume' instance f78dee55-4357-4bb4-8057-ddecdd7326f6 while it is in vm_state rescued {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:19:35.045885 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a6ef6516-5aa2-47f3-9ff0-8a7062c3e3ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments/0632c8ba-912c-4809-bfb6-faaf605c405d" status: 409 len: 152 microversion: 2.1 time: 0.156236 May 16 15:19:35.045885 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 288/574] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:19:34 2022] DELETE /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments/0632c8ba-912c-4809-bfb6-faaf605c405d => generated 152 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 15:19:35.046145 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8d52aa71-0d96-484e-bb4f-d253eb3e186e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:35.046145 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8d52aa71-0d96-484e-bb4f-d253eb3e186e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:35.047881 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d52aa71-0d96-484e-bb4f-d253eb3e186e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:35.048386 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d52aa71-0d96-484e-bb4f-d253eb3e186e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:35.049166 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d52aa71-0d96-484e-bb4f-d253eb3e186e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:35.049604 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d52aa71-0d96-484e-bb4f-d253eb3e186e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:35.428350 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-68ac58f1-b57a-4200-9fd7-98758cb72e1a tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:35.428952 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-68ac58f1-b57a-4200-9fd7-98758cb72e1a tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:35.482154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-68ac58f1-b57a-4200-9fd7-98758cb72e1a tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:35.492034 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-68ac58f1-b57a-4200-9fd7-98758cb72e1a tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1217 microversion: 2.1 time: 0.068228 May 16 15:19:35.501251 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 289/575] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:35 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:19:35.534208 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8d52aa71-0d96-484e-bb4f-d253eb3e186e tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "POST /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/action" status: 202 len: 0 microversion: 2.1 time: 0.498268 May 16 15:19:35.538835 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 287/576] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:19:35 2022] POST /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:19:35.543598 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc01381d-8208-457c-9bfb-1776b576e4e1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:35.544203 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cc01381d-8208-457c-9bfb-1776b576e4e1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:35.550198 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc01381d-8208-457c-9bfb-1776b576e4e1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:35.550642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc01381d-8208-457c-9bfb-1776b576e4e1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:35.551407 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc01381d-8208-457c-9bfb-1776b576e4e1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:35.551834 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc01381d-8208-457c-9bfb-1776b576e4e1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:35.695777 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cc01381d-8208-457c-9bfb-1776b576e4e1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:35.713560 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cc01381d-8208-457c-9bfb-1776b576e4e1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1723 microversion: 2.1 time: 0.173804 May 16 15:19:35.716764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 290/577] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:35 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:36.143976 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-a1fd1de4-4ab7-4b1e-8c5c-5d3b75b25d0e req-6355b403-c9b3-4a4f-8c2e-4a1299f275df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7914c5a4-73f7-4114-a4ec-d583fecff5ec", "tag": "c65d1e07-7d92-45c0-afcb-735f16828214"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:36.153992 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a1fd1de4-4ab7-4b1e-8c5c-5d3b75b25d0e req-6355b403-c9b3-4a4f-8c2e-4a1299f275df service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:36.154473 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a1fd1de4-4ab7-4b1e-8c5c-5d3b75b25d0e req-6355b403-c9b3-4a4f-8c2e-4a1299f275df service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:36.176490 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-a1fd1de4-4ab7-4b1e-8c5c-5d3b75b25d0e req-6355b403-c9b3-4a4f-8c2e-4a1299f275df service nova] Creating event network-changed:c65d1e07-7d92-45c0-afcb-735f16828214 for instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec on hv-cinder-79578 May 16 15:19:36.193972 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-a1fd1de4-4ab7-4b1e-8c5c-5d3b75b25d0e req-6355b403-c9b3-4a4f-8c2e-4a1299f275df service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054327 May 16 15:19:36.194713 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 288/578] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:36.508722 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-92f1ba94-6d01-4021-81fd-c26efc1f651c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:36.509615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-92f1ba94-6d01-4021-81fd-c26efc1f651c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:36.515772 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92f1ba94-6d01-4021-81fd-c26efc1f651c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:36.516233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92f1ba94-6d01-4021-81fd-c26efc1f651c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:36.517011 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92f1ba94-6d01-4021-81fd-c26efc1f651c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:36.517442 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92f1ba94-6d01-4021-81fd-c26efc1f651c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:36.580035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-92f1ba94-6d01-4021-81fd-c26efc1f651c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:36.587788 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-92f1ba94-6d01-4021-81fd-c26efc1f651c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1269 microversion: 2.1 time: 0.082962 May 16 15:19:36.588355 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 291/579] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:36 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:36.732677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e1c56384-5ccf-4e74-b462-4b7d3511879f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:36.733274 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e1c56384-5ccf-4e74-b462-4b7d3511879f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:36.739237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e1c56384-5ccf-4e74-b462-4b7d3511879f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:36.739685 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e1c56384-5ccf-4e74-b462-4b7d3511879f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:36.740456 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e1c56384-5ccf-4e74-b462-4b7d3511879f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:36.740884 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e1c56384-5ccf-4e74-b462-4b7d3511879f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:36.868310 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e1c56384-5ccf-4e74-b462-4b7d3511879f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:36.877874 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e1c56384-5ccf-4e74-b462-4b7d3511879f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1723 microversion: 2.1 time: 0.150260 May 16 15:19:36.878485 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 289/580] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:36 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:37.604430 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc78c421-3055-45f0-933f-56eb1155ebea tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:37.605067 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cc78c421-3055-45f0-933f-56eb1155ebea tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:37.611419 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc78c421-3055-45f0-933f-56eb1155ebea tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:37.611864 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc78c421-3055-45f0-933f-56eb1155ebea tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:37.612620 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc78c421-3055-45f0-933f-56eb1155ebea tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:37.613054 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc78c421-3055-45f0-933f-56eb1155ebea tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:37.675599 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cc78c421-3055-45f0-933f-56eb1155ebea tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:37.682636 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cc78c421-3055-45f0-933f-56eb1155ebea tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1269 microversion: 2.1 time: 0.082006 May 16 15:19:37.683189 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 292/581] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:37 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:37.895783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d9809d1e-4fde-44c7-8be8-6418a7a6e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:37.896342 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d9809d1e-4fde-44c7-8be8-6418a7a6e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:37.902688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9809d1e-4fde-44c7-8be8-6418a7a6e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:37.903137 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9809d1e-4fde-44c7-8be8-6418a7a6e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:37.903897 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9809d1e-4fde-44c7-8be8-6418a7a6e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:37.904328 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9809d1e-4fde-44c7-8be8-6418a7a6e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:38.032453 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d9809d1e-4fde-44c7-8be8-6418a7a6e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:38.040180 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d9809d1e-4fde-44c7-8be8-6418a7a6e94b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1723 microversion: 2.1 time: 0.148333 May 16 15:19:38.040748 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 290/582] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:37 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:38.699501 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7ba2df31-b786-4820-a771-8a7c698403c8 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:38.700106 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7ba2df31-b786-4820-a771-8a7c698403c8 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:38.706510 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ba2df31-b786-4820-a771-8a7c698403c8 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:38.710769 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ba2df31-b786-4820-a771-8a7c698403c8 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:38.710769 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ba2df31-b786-4820-a771-8a7c698403c8 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:38.710769 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ba2df31-b786-4820-a771-8a7c698403c8 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:38.767413 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7ba2df31-b786-4820-a771-8a7c698403c8 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:38.775416 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7ba2df31-b786-4820-a771-8a7c698403c8 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1277 microversion: 2.1 time: 0.079773 May 16 15:19:38.775988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 293/583] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:38 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1277 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:39.056786 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ddbdb2dc-74b3-4319-8669-0c8f0d43d33a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:39.057399 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ddbdb2dc-74b3-4319-8669-0c8f0d43d33a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:39.063941 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ddbdb2dc-74b3-4319-8669-0c8f0d43d33a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:39.064395 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ddbdb2dc-74b3-4319-8669-0c8f0d43d33a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:39.065168 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ddbdb2dc-74b3-4319-8669-0c8f0d43d33a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:39.065608 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ddbdb2dc-74b3-4319-8669-0c8f0d43d33a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:39.191354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ddbdb2dc-74b3-4319-8669-0c8f0d43d33a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:39.199608 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ddbdb2dc-74b3-4319-8669-0c8f0d43d33a tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1723 microversion: 2.1 time: 0.146671 May 16 15:19:39.200178 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 291/584] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:39 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:39.792945 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-570dcf45-6699-48bb-823d-e609a7014bb9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:39.793550 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-570dcf45-6699-48bb-823d-e609a7014bb9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:39.799847 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-570dcf45-6699-48bb-823d-e609a7014bb9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:39.800283 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-570dcf45-6699-48bb-823d-e609a7014bb9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:39.801042 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-570dcf45-6699-48bb-823d-e609a7014bb9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:39.801519 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-570dcf45-6699-48bb-823d-e609a7014bb9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:39.872925 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-570dcf45-6699-48bb-823d-e609a7014bb9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:39.880282 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-570dcf45-6699-48bb-823d-e609a7014bb9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1275 microversion: 2.1 time: 0.091232 May 16 15:19:39.880845 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 294/585] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:39 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:40.216827 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-64c5bf3e-ec7a-4b9e-abd4-033b3b951973 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:40.217441 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-64c5bf3e-ec7a-4b9e-abd4-033b3b951973 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:40.223709 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64c5bf3e-ec7a-4b9e-abd4-033b3b951973 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:40.224719 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64c5bf3e-ec7a-4b9e-abd4-033b3b951973 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:40.225564 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64c5bf3e-ec7a-4b9e-abd4-033b3b951973 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:40.225995 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64c5bf3e-ec7a-4b9e-abd4-033b3b951973 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:40.351171 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-64c5bf3e-ec7a-4b9e-abd4-033b3b951973 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:40.359324 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-64c5bf3e-ec7a-4b9e-abd4-033b3b951973 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1729 microversion: 2.1 time: 0.146233 May 16 15:19:40.359912 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 292/586] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:40 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1729 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:40.375455 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-39a13bf2-2f70-4b9d-8872-50dbd95cefef tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:40.375941 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-39a13bf2-2f70-4b9d-8872-50dbd95cefef tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:40.381817 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39a13bf2-2f70-4b9d-8872-50dbd95cefef tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:40.382291 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39a13bf2-2f70-4b9d-8872-50dbd95cefef tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:40.383051 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39a13bf2-2f70-4b9d-8872-50dbd95cefef tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:40.383477 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39a13bf2-2f70-4b9d-8872-50dbd95cefef tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:40.523256 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-39a13bf2-2f70-4b9d-8872-50dbd95cefef tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151613 May 16 15:19:40.523853 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 295/587] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 16 15:19:40 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:40.896719 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-75e122f8-eb2e-4534-93dc-968acc6a75b7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:40.897326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-75e122f8-eb2e-4534-93dc-968acc6a75b7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:40.903156 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75e122f8-eb2e-4534-93dc-968acc6a75b7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:40.903606 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75e122f8-eb2e-4534-93dc-968acc6a75b7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:40.904371 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75e122f8-eb2e-4534-93dc-968acc6a75b7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:40.904803 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75e122f8-eb2e-4534-93dc-968acc6a75b7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:41.033885 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-75e122f8-eb2e-4534-93dc-968acc6a75b7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:41.041320 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-75e122f8-eb2e-4534-93dc-968acc6a75b7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1317 microversion: 2.1 time: 0.148514 May 16 15:19:41.042112 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 293/588] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:40 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:41.665910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-43d48e17-3719-40e7-ad75-86740b649102 req-3c91fb8d-49e6-44fd-aeab-356ab346004c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5abda4a-52f9-4b01-9c65-675397422c41", "tag": "e096f6ef-c70e-4e67-b7f3-eb68492a38f7"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:41.677601 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-43d48e17-3719-40e7-ad75-86740b649102 req-3c91fb8d-49e6-44fd-aeab-356ab346004c service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:41.679358 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-43d48e17-3719-40e7-ad75-86740b649102 req-3c91fb8d-49e6-44fd-aeab-356ab346004c service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:41.696688 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-43d48e17-3719-40e7-ad75-86740b649102 req-3c91fb8d-49e6-44fd-aeab-356ab346004c service nova] Creating event network-changed:e096f6ef-c70e-4e67-b7f3-eb68492a38f7 for instance e5abda4a-52f9-4b01-9c65-675397422c41 on hv-cinder-79578 May 16 15:19:41.701647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-43d48e17-3719-40e7-ad75-86740b649102 req-3c91fb8d-49e6-44fd-aeab-356ab346004c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040019 May 16 15:19:41.702290 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 296/589] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:42.058146 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-441b6f4e-7d81-409e-be5f-b5ac71f46c10 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:42.059010 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-441b6f4e-7d81-409e-be5f-b5ac71f46c10 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:42.065918 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-441b6f4e-7d81-409e-be5f-b5ac71f46c10 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:42.070839 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-441b6f4e-7d81-409e-be5f-b5ac71f46c10 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:42.070839 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-441b6f4e-7d81-409e-be5f-b5ac71f46c10 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:42.070839 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-441b6f4e-7d81-409e-be5f-b5ac71f46c10 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:42.209626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-441b6f4e-7d81-409e-be5f-b5ac71f46c10 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:42.216839 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-441b6f4e-7d81-409e-be5f-b5ac71f46c10 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1317 microversion: 2.1 time: 0.162585 May 16 15:19:42.217440 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 294/590] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:42 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:43.234611 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-91afae88-fcc9-4a03-bd3c-cd8022119602 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:43.235296 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-91afae88-fcc9-4a03-bd3c-cd8022119602 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:43.241924 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91afae88-fcc9-4a03-bd3c-cd8022119602 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:43.242395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91afae88-fcc9-4a03-bd3c-cd8022119602 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:43.243146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91afae88-fcc9-4a03-bd3c-cd8022119602 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:43.243572 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91afae88-fcc9-4a03-bd3c-cd8022119602 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:43.373620 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-91afae88-fcc9-4a03-bd3c-cd8022119602 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:43.381638 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-91afae88-fcc9-4a03-bd3c-cd8022119602 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1317 microversion: 2.1 time: 0.151643 May 16 15:19:43.382227 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 297/591] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:43 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:43.716892 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-c907b3c9-8734-4b0f-84f2-3e59e6fbbdfe req-e1780dac-2d80-4464-a82a-6ef0b9d610c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f78dee55-4357-4bb4-8057-ddecdd7326f6", "tag": "0a775fd5-0c4b-4d34-8fea-0665c23c121b"}, {"name": "network-changed", "server_uuid": "f78dee55-4357-4bb4-8057-ddecdd7326f6", "tag": "0a775fd5-0c4b-4d34-8fea-0665c23c121b"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:43.725959 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-c907b3c9-8734-4b0f-84f2-3e59e6fbbdfe req-e1780dac-2d80-4464-a82a-6ef0b9d610c1 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:43.726430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-c907b3c9-8734-4b0f-84f2-3e59e6fbbdfe req-e1780dac-2d80-4464-a82a-6ef0b9d610c1 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:43.736720 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-c907b3c9-8734-4b0f-84f2-3e59e6fbbdfe req-e1780dac-2d80-4464-a82a-6ef0b9d610c1 service nova] Creating event network-changed:0a775fd5-0c4b-4d34-8fea-0665c23c121b for instance f78dee55-4357-4bb4-8057-ddecdd7326f6 on hv-cinder-79578 May 16 15:19:43.737228 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-c907b3c9-8734-4b0f-84f2-3e59e6fbbdfe req-e1780dac-2d80-4464-a82a-6ef0b9d610c1 service nova] Creating event network-changed:0a775fd5-0c4b-4d34-8fea-0665c23c121b for instance f78dee55-4357-4bb4-8057-ddecdd7326f6 on hv-cinder-79578 May 16 15:19:43.742772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-c907b3c9-8734-4b0f-84f2-3e59e6fbbdfe req-e1780dac-2d80-4464-a82a-6ef0b9d610c1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.029547 May 16 15:19:43.743328 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 295/592] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:44.403555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5de6d701-e19f-479a-9b57-970a7185b24b tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:44.404160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5de6d701-e19f-479a-9b57-970a7185b24b tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:44.416867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5de6d701-e19f-479a-9b57-970a7185b24b tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.417307 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5de6d701-e19f-479a-9b57-970a7185b24b tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.425384 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5de6d701-e19f-479a-9b57-970a7185b24b tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:44.426463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5de6d701-e19f-479a-9b57-970a7185b24b tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:44.613292 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5de6d701-e19f-479a-9b57-970a7185b24b tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:44.621238 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5de6d701-e19f-479a-9b57-970a7185b24b tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1317 microversion: 2.1 time: 0.226087 May 16 15:19:44.621871 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 298/593] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:44 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:45.639783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8ccbc5bc-1bab-48ed-b189-920135b8b3cb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:45.640470 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8ccbc5bc-1bab-48ed-b189-920135b8b3cb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:45.647331 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8ccbc5bc-1bab-48ed-b189-920135b8b3cb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:45.647782 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8ccbc5bc-1bab-48ed-b189-920135b8b3cb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:45.648550 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8ccbc5bc-1bab-48ed-b189-920135b8b3cb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:45.648991 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8ccbc5bc-1bab-48ed-b189-920135b8b3cb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:45.777113 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8ccbc5bc-1bab-48ed-b189-920135b8b3cb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:45.784339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8ccbc5bc-1bab-48ed-b189-920135b8b3cb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1317 microversion: 2.1 time: 0.149159 May 16 15:19:45.784903 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 296/594] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:45 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:46.513633 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-f34606f1-2faf-4c61-9847-69340b71aca8 req-248ecdb8-542e-42e7-a2da-9b3cb0b3f69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5abda4a-52f9-4b01-9c65-675397422c41", "name": "network-vif-plugged", "status": "completed", "tag": "e096f6ef-c70e-4e67-b7f3-eb68492a38f7"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:19:46.522730 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-f34606f1-2faf-4c61-9847-69340b71aca8 req-248ecdb8-542e-42e7-a2da-9b3cb0b3f69f service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:46.523165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-f34606f1-2faf-4c61-9847-69340b71aca8 req-248ecdb8-542e-42e7-a2da-9b3cb0b3f69f service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:46.533479 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-f34606f1-2faf-4c61-9847-69340b71aca8 req-248ecdb8-542e-42e7-a2da-9b3cb0b3f69f service nova] Creating event network-vif-plugged:e096f6ef-c70e-4e67-b7f3-eb68492a38f7 for instance e5abda4a-52f9-4b01-9c65-675397422c41 on hv-cinder-79578 May 16 15:19:46.538122 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-f34606f1-2faf-4c61-9847-69340b71aca8 req-248ecdb8-542e-42e7-a2da-9b3cb0b3f69f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028080 May 16 15:19:46.538739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 299/595] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:19:46.800741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f34e2033-3172-486b-9ab8-482d781bfa15 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:46.801347 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f34e2033-3172-486b-9ab8-482d781bfa15 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:46.807721 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f34e2033-3172-486b-9ab8-482d781bfa15 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:46.808168 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f34e2033-3172-486b-9ab8-482d781bfa15 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:46.808927 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f34e2033-3172-486b-9ab8-482d781bfa15 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:46.809356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f34e2033-3172-486b-9ab8-482d781bfa15 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:46.937782 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f34e2033-3172-486b-9ab8-482d781bfa15 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:46.945702 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f34e2033-3172-486b-9ab8-482d781bfa15 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1317 microversion: 2.1 time: 0.148968 May 16 15:19:46.946302 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 297/596] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:46 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:47.963700 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fd042170-eef4-468c-85d9-b4712a2a909e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:47.964331 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fd042170-eef4-468c-85d9-b4712a2a909e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:47.970454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd042170-eef4-468c-85d9-b4712a2a909e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:47.970895 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd042170-eef4-468c-85d9-b4712a2a909e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:47.971645 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd042170-eef4-468c-85d9-b4712a2a909e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:47.972074 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd042170-eef4-468c-85d9-b4712a2a909e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:48.106827 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fd042170-eef4-468c-85d9-b4712a2a909e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:48.114690 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fd042170-eef4-468c-85d9-b4712a2a909e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1317 microversion: 2.1 time: 0.155293 May 16 15:19:48.115311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 300/597] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:47 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:49.132067 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1d7247bf-442e-47e0-8db5-f13bf9e6248f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:49.132710 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1d7247bf-442e-47e0-8db5-f13bf9e6248f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:19:49.138704 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d7247bf-442e-47e0-8db5-f13bf9e6248f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:49.139156 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d7247bf-442e-47e0-8db5-f13bf9e6248f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:49.139925 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d7247bf-442e-47e0-8db5-f13bf9e6248f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:49.140362 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d7247bf-442e-47e0-8db5-f13bf9e6248f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:49.268100 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1d7247bf-442e-47e0-8db5-f13bf9e6248f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:19:49.275673 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1d7247bf-442e-47e0-8db5-f13bf9e6248f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1507 microversion: 2.1 time: 0.148201 May 16 15:19:49.276232 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 298/598] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:19:49 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:08.801606 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-342a9240-9643-4206-8afd-304357beec3c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "912d2879-2599-400a-8dec-b3989fbf9a11", "device": "/dev/sdb"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:08.803192 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-342a9240-9643-4206-8afd-304357beec3c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:08.809882 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-342a9240-9643-4206-8afd-304357beec3c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:08.810618 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-342a9240-9643-4206-8afd-304357beec3c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:08.811364 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-342a9240-9643-4206-8afd-304357beec3c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:08.811791 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-342a9240-9643-4206-8afd-304357beec3c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:09.434818 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-342a9240-9643-4206-8afd-304357beec3c tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "POST /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.636735 May 16 15:20:09.435581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 301/599] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:20:08 2022] POST /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:12.140779 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-97959516-6851-48c5-8a54-74d1196b781a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1332313170"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:12.141310 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-97959516-6851-48c5-8a54-74d1196b781a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:12.147767 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-97959516-6851-48c5-8a54-74d1196b781a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:12.148222 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-97959516-6851-48c5-8a54-74d1196b781a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:12.148952 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-97959516-6851-48c5-8a54-74d1196b781a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:12.149377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-97959516-6851-48c5-8a54-74d1196b781a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:12.273744 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.network.security_group_api [None req-97959516-6851-48c5-8a54-74d1196b781a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Removing security group bd80e2ed-795d-481f-ae0d-33b1c9403e7c from port 3904bae9-9274-4a0f-8757-bdbf49cf6aff May 16 15:20:12.694238 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-97959516-6851-48c5-8a54-74d1196b781a tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "POST /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/action" status: 202 len: 0 microversion: 2.1 time: 0.557186 May 16 15:20:12.700679 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 299/600] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:20:12 2022] POST /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:20:12.709186 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-f77191c9-14df-40fd-a2c9-77d67b00a44c req-710ec362-f119-462c-8c55-e802b385628b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2587084-89a0-47a8-909d-019d48b12e5c", "tag": "3904bae9-9274-4a0f-8757-bdbf49cf6aff"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:12.721668 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-f77191c9-14df-40fd-a2c9-77d67b00a44c req-710ec362-f119-462c-8c55-e802b385628b service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:12.722358 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-f77191c9-14df-40fd-a2c9-77d67b00a44c req-710ec362-f119-462c-8c55-e802b385628b service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:12.734428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-f77191c9-14df-40fd-a2c9-77d67b00a44c req-710ec362-f119-462c-8c55-e802b385628b service nova] Creating event network-changed:3904bae9-9274-4a0f-8757-bdbf49cf6aff for instance f2587084-89a0-47a8-909d-019d48b12e5c on hv-cinder-79578 May 16 15:20:12.751184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-f77191c9-14df-40fd-a2c9-77d67b00a44c req-710ec362-f119-462c-8c55-e802b385628b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045245 May 16 15:20:12.752420 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 302/601] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:13.977083 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2c6cc96e-2791-4c2b-9a58-a1b8bf736435 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:13.977595 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2c6cc96e-2791-4c2b-9a58-a1b8bf736435 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:13.984093 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2c6cc96e-2791-4c2b-9a58-a1b8bf736435 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.984545 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2c6cc96e-2791-4c2b-9a58-a1b8bf736435 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:13.985313 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2c6cc96e-2791-4c2b-9a58-a1b8bf736435 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:13.985926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2c6cc96e-2791-4c2b-9a58-a1b8bf736435 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:14.067773 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-2c6cc96e-2791-4c2b-9a58-a1b8bf736435 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lazy-loading 'services' on Instance uuid f2587084-89a0-47a8-909d-019d48b12e5c {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:14.264126 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2c6cc96e-2791-4c2b-9a58-a1b8bf736435 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments/c23d5a3e-4134-49df-bf05-46017bf00606" status: 202 len: 0 microversion: 2.1 time: 0.291322 May 16 15:20:14.264794 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 300/602] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:20:13 2022] DELETE /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments/c23d5a3e-4134-49df-bf05-46017bf00606 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:20:14.273910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8fa82341-9f74-4c8d-9d3b-d42648c8d657 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:14.275070 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8fa82341-9f74-4c8d-9d3b-d42648c8d657 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:14.285669 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fa82341-9f74-4c8d-9d3b-d42648c8d657 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:14.294831 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fa82341-9f74-4c8d-9d3b-d42648c8d657 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:14.294831 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fa82341-9f74-4c8d-9d3b-d42648c8d657 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:14.294831 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fa82341-9f74-4c8d-9d3b-d42648c8d657 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:14.325472 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8fa82341-9f74-4c8d-9d3b-d42648c8d657 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055828 May 16 15:20:14.326019 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 303/603] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:14 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:14.770538 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-26e07641-57a5-45fd-b218-aec7e3f06213 req-c1e38c79-0a20-4b81-885d-eff615ec6c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2587084-89a0-47a8-909d-019d48b12e5c", "tag": "3904bae9-9274-4a0f-8757-bdbf49cf6aff"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:14.779509 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-26e07641-57a5-45fd-b218-aec7e3f06213 req-c1e38c79-0a20-4b81-885d-eff615ec6c97 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:14.779949 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-26e07641-57a5-45fd-b218-aec7e3f06213 req-c1e38c79-0a20-4b81-885d-eff615ec6c97 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:14.792651 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-26e07641-57a5-45fd-b218-aec7e3f06213 req-c1e38c79-0a20-4b81-885d-eff615ec6c97 service nova] Creating event network-changed:3904bae9-9274-4a0f-8757-bdbf49cf6aff for instance f2587084-89a0-47a8-909d-019d48b12e5c on hv-cinder-79578 May 16 15:20:14.797783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-26e07641-57a5-45fd-b218-aec7e3f06213 req-c1e38c79-0a20-4b81-885d-eff615ec6c97 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031894 May 16 15:20:14.799088 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 301/604] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:15.337724 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-df85769a-b2b5-421f-8f23-7409439b32df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:15.338721 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-df85769a-b2b5-421f-8f23-7409439b32df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:15.345070 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df85769a-b2b5-421f-8f23-7409439b32df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:15.345524 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df85769a-b2b5-421f-8f23-7409439b32df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:15.346338 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df85769a-b2b5-421f-8f23-7409439b32df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:15.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df85769a-b2b5-421f-8f23-7409439b32df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:15.380198 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-df85769a-b2b5-421f-8f23-7409439b32df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046580 May 16 15:20:15.380738 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 304/605] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:15 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:16.393018 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ce190e15-9264-4e71-96b6-809779a06c6f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:16.393985 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ce190e15-9264-4e71-96b6-809779a06c6f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:16.400766 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce190e15-9264-4e71-96b6-809779a06c6f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:16.401221 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce190e15-9264-4e71-96b6-809779a06c6f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:16.402002 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce190e15-9264-4e71-96b6-809779a06c6f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:16.402468 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce190e15-9264-4e71-96b6-809779a06c6f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:16.431055 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ce190e15-9264-4e71-96b6-809779a06c6f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042739 May 16 15:20:16.431614 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 302/606] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:16 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:17.442326 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5049796f-ff72-442f-9449-ac4f120fceb9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:17.443176 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5049796f-ff72-442f-9449-ac4f120fceb9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:17.449612 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5049796f-ff72-442f-9449-ac4f120fceb9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:17.450056 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5049796f-ff72-442f-9449-ac4f120fceb9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:17.450851 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5049796f-ff72-442f-9449-ac4f120fceb9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:17.451284 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5049796f-ff72-442f-9449-ac4f120fceb9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:17.480513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5049796f-ff72-442f-9449-ac4f120fceb9 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042292 May 16 15:20:17.481069 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 305/607] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:17 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:18.492480 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2cbd781a-96d8-441c-bf95-a0bb3892b1ea tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:18.493443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2cbd781a-96d8-441c-bf95-a0bb3892b1ea tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:18.500171 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cbd781a-96d8-441c-bf95-a0bb3892b1ea tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:18.500625 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cbd781a-96d8-441c-bf95-a0bb3892b1ea tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:18.501394 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cbd781a-96d8-441c-bf95-a0bb3892b1ea tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:18.501838 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cbd781a-96d8-441c-bf95-a0bb3892b1ea tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:18.530051 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2cbd781a-96d8-441c-bf95-a0bb3892b1ea tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041855 May 16 15:20:18.530643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 303/608] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:18 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:20:18.541273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c7f06898-d329-4263-856e-53d35782c8fd tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:18.541773 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c7f06898-d329-4263-856e-53d35782c8fd tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:18.548723 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7f06898-d329-4263-856e-53d35782c8fd tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:18.549170 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7f06898-d329-4263-856e-53d35782c8fd tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:18.549938 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7f06898-d329-4263-856e-53d35782c8fd tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:18.550402 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7f06898-d329-4263-856e-53d35782c8fd tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:18.732130 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-c7f06898-d329-4263-856e-53d35782c8fd tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] HTTP exception thrown: Instance f2587084-89a0-47a8-909d-019d48b12e5c is not attached to volume c23d5a3e-4134-49df-bf05-46017bf00606 May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c7f06898-d329-4263-856e-53d35782c8fd tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Request method failure captured: May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments/c23d5a3e-4134-49df-bf05-46017bf00606 HTTP/1.1 May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmrtzAFKavX8DTWzumkNe0hhmG5DDs2HAS5ZqHwq5gfdpBIOPfq7bzATQvE2bBGfNVKSXA2IK-_KpmyuaYOBKmZ1HFghEniut7Oxbm-wnMY5MGsh2mYiPcg3LGi-GhDSNDKjaFD3xgWB_85Di6ndVa8XhdxKAYtR6J3RyiSX0d_9tz8 May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 18afd7d9815342c196be824d2b99d537 May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-TestMinimumBasicScenario-1692797995 May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:20:18.738024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:20:18.739849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/18afd7d9815342c196be824d2b99d537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/18afd7d9815342c196be824d2b99d537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/18afd7d9815342c196be824d2b99d537"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_18afd7d9815342c196be824d2b99d537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:20:18.739849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-TestMinimumBasicScenario-1692797995 May 16 15:20:18.739849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 18afd7d9815342c196be824d2b99d537 May 16 15:20:18.739849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1692797995 May 16 15:20:18.739849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-TestMinimumBasicScenario-1692797995-project May 16 15:20:18.739849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:20:18.739849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:20:18.739849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 064ef0ac470b458ba5a675364f9cab31 May 16 15:20:18.739849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-TestMinimumBasicScenario-1692797995-project May 16 15:20:18.739849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:20:18.739849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance f2587084-89a0-47a8-909d-019d48b12e5c is not attached to volume c23d5a3e-4134-49df-bf05-46017bf00606 May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'server_id': 'f2587084-89a0-47a8-909d-019d48b12e5c', 'id': 'c23d5a3e-4134-49df-bf05-46017bf00606'} May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c23d5a3e-4134-49df-bf05-46017bf00606. May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:20:18.740680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2587084-89a0-47a8-909d-019d48b12e5c is not attached to volume c23d5a3e-4134-49df-bf05-46017bf00606 May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2587084-89a0-47a8-909d-019d48b12e5c is not attached to volume c23d5a3e-4134-49df-bf05-46017bf00606 May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:18.741888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c7f06898-d329-4263-856e-53d35782c8fd tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Returning 404 to user: Instance f2587084-89a0-47a8-909d-019d48b12e5c is not attached to volume c23d5a3e-4134-49df-bf05-46017bf00606 {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:20:18.742999 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c7f06898-d329-4263-856e-53d35782c8fd tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments/c23d5a3e-4134-49df-bf05-46017bf00606" status: 404 len: 154 microversion: 2.1 time: 0.202338 May 16 15:20:18.742999 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 306/609] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:20:18 2022] DELETE /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c/os-volume_attachments/c23d5a3e-4134-49df-bf05-46017bf00606 => generated 154 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:20:21.623194 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-96631f20-1e0d-42c1-9321-f3415412a48e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:21.624260 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-96631f20-1e0d-42c1-9321-f3415412a48e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:21.630730 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96631f20-1e0d-42c1-9321-f3415412a48e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:21.631183 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96631f20-1e0d-42c1-9321-f3415412a48e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:21.631955 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96631f20-1e0d-42c1-9321-f3415412a48e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:21.632394 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-96631f20-1e0d-42c1-9321-f3415412a48e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:21.661669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-96631f20-1e0d-42c1-9321-f3415412a48e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042378 May 16 15:20:21.662230 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 304/610] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:21 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 15:20:21.721255 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-93c98c79-e468-4def-857b-06c045016abe tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:21.721783 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-93c98c79-e468-4def-857b-06c045016abe tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:21.729049 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93c98c79-e468-4def-857b-06c045016abe tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:21.729525 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93c98c79-e468-4def-857b-06c045016abe tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:21.730375 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93c98c79-e468-4def-857b-06c045016abe tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:21.730816 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93c98c79-e468-4def-857b-06c045016abe tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:21.754519 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-93c98c79-e468-4def-857b-06c045016abe tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:20:22.132335 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-93c98c79-e468-4def-857b-06c045016abe tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 204 len: 0 microversion: 2.1 time: 0.414565 May 16 15:20:22.132932 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 307/611] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:20:21 2022] DELETE /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:20:22.141625 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cd639a7e-d782-4b5f-ba0b-171a71595692 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:22.142276 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cd639a7e-d782-4b5f-ba0b-171a71595692 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:22.148163 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd639a7e-d782-4b5f-ba0b-171a71595692 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:22.148744 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd639a7e-d782-4b5f-ba0b-171a71595692 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:22.149559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd639a7e-d782-4b5f-ba0b-171a71595692 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:22.150031 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd639a7e-d782-4b5f-ba0b-171a71595692 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:22.327320 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cd639a7e-d782-4b5f-ba0b-171a71595692 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:22.334669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cd639a7e-d782-4b5f-ba0b-171a71595692 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1672 microversion: 2.1 time: 0.197518 May 16 15:20:22.335240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 305/612] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:22 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1672 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:23.094051 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-02e1e751-d7c6-486a-b523-84c5bc527283 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:23.094661 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-02e1e751-d7c6-486a-b523-84c5bc527283 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:23.101697 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02e1e751-d7c6-486a-b523-84c5bc527283 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:23.102175 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02e1e751-d7c6-486a-b523-84c5bc527283 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:23.102953 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02e1e751-d7c6-486a-b523-84c5bc527283 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:23.103408 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02e1e751-d7c6-486a-b523-84c5bc527283 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:23.128849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-02e1e751-d7c6-486a-b523-84c5bc527283 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:20:23.352916 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6a852442-10c2-4344-a6af-20847870a796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:23.353560 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6a852442-10c2-4344-a6af-20847870a796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:23.360110 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a852442-10c2-4344-a6af-20847870a796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:23.360563 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a852442-10c2-4344-a6af-20847870a796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:23.361422 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a852442-10c2-4344-a6af-20847870a796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:23.361857 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a852442-10c2-4344-a6af-20847870a796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:23.391450 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-02e1e751-d7c6-486a-b523-84c5bc527283 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 204 len: 0 microversion: 2.1 time: 0.301274 May 16 15:20:23.392054 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 308/613] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:20:23 2022] DELETE /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:20:23.401117 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d4df44c9-b195-4b50-ac7d-f796fe60b10f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:23.401816 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d4df44c9-b195-4b50-ac7d-f796fe60b10f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:23.407728 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4df44c9-b195-4b50-ac7d-f796fe60b10f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:23.408179 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4df44c9-b195-4b50-ac7d-f796fe60b10f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:23.408957 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4df44c9-b195-4b50-ac7d-f796fe60b10f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:23.409398 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4df44c9-b195-4b50-ac7d-f796fe60b10f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:23.494213 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6a852442-10c2-4344-a6af-20847870a796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:23.501734 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6a852442-10c2-4344-a6af-20847870a796 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1672 microversion: 2.1 time: 0.153858 May 16 15:20:23.502327 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 306/614] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:23 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:23.541028 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d4df44c9-b195-4b50-ac7d-f796fe60b10f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:23.548324 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d4df44c9-b195-4b50-ac7d-f796fe60b10f tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1555 microversion: 2.1 time: 0.151899 May 16 15:20:23.548890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 309/615] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:23 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:24.520328 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-66772d64-c4ce-47c2-9f8e-56ddce805ab3 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:24.520850 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-66772d64-c4ce-47c2-9f8e-56ddce805ab3 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:24.527180 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66772d64-c4ce-47c2-9f8e-56ddce805ab3 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:24.527641 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66772d64-c4ce-47c2-9f8e-56ddce805ab3 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:24.528386 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66772d64-c4ce-47c2-9f8e-56ddce805ab3 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:24.528814 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66772d64-c4ce-47c2-9f8e-56ddce805ab3 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:24.565291 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7e6a2ab5-0c51-41a4-8acb-5cb678771b32 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:24.565912 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7e6a2ab5-0c51-41a4-8acb-5cb678771b32 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:24.572437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e6a2ab5-0c51-41a4-8acb-5cb678771b32 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:24.572891 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e6a2ab5-0c51-41a4-8acb-5cb678771b32 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:24.573691 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e6a2ab5-0c51-41a4-8acb-5cb678771b32 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:24.574152 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e6a2ab5-0c51-41a4-8acb-5cb678771b32 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:24.659462 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-66772d64-c4ce-47c2-9f8e-56ddce805ab3 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:24.667329 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-66772d64-c4ce-47c2-9f8e-56ddce805ab3 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1672 microversion: 2.1 time: 0.151089 May 16 15:20:24.667993 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 307/616] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:24 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:24.706341 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7e6a2ab5-0c51-41a4-8acb-5cb678771b32 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:24.713616 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7e6a2ab5-0c51-41a4-8acb-5cb678771b32 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1555 microversion: 2.1 time: 0.152119 May 16 15:20:24.714187 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 310/617] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:24 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:25.730201 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5fa6ad0d-4d6c-4b8d-a068-2e2acfde37ad tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:25.730876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5fa6ad0d-4d6c-4b8d-a068-2e2acfde37ad tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:25.737257 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fa6ad0d-4d6c-4b8d-a068-2e2acfde37ad tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:25.737703 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fa6ad0d-4d6c-4b8d-a068-2e2acfde37ad tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:25.738986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fa6ad0d-4d6c-4b8d-a068-2e2acfde37ad tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:25.739421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fa6ad0d-4d6c-4b8d-a068-2e2acfde37ad tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:25.785089 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cc49bbae-fffa-40f4-ae30-9d267c77282b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:25.785705 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cc49bbae-fffa-40f4-ae30-9d267c77282b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:25.791609 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc49bbae-fffa-40f4-ae30-9d267c77282b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:25.792057 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc49bbae-fffa-40f4-ae30-9d267c77282b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:25.792826 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc49bbae-fffa-40f4-ae30-9d267c77282b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:25.793260 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc49bbae-fffa-40f4-ae30-9d267c77282b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:25.869995 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5fa6ad0d-4d6c-4b8d-a068-2e2acfde37ad tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:25.877297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5fa6ad0d-4d6c-4b8d-a068-2e2acfde37ad tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1555 microversion: 2.1 time: 0.150883 May 16 15:20:25.877869 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 311/618] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:25 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:25.923122 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cc49bbae-fffa-40f4-ae30-9d267c77282b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:25.931487 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cc49bbae-fffa-40f4-ae30-9d267c77282b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1672 microversion: 2.1 time: 0.249724 May 16 15:20:25.932072 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 308/619] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:25 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1672 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:26.894737 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-24eb4126-a14b-4211-ba8f-937c14b62c52 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:26.895422 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-24eb4126-a14b-4211-ba8f-937c14b62c52 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:26.902446 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24eb4126-a14b-4211-ba8f-937c14b62c52 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:26.902902 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24eb4126-a14b-4211-ba8f-937c14b62c52 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:26.903669 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24eb4126-a14b-4211-ba8f-937c14b62c52 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:26.904100 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24eb4126-a14b-4211-ba8f-937c14b62c52 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:26.949847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f74094b6-c93a-4dd9-9471-2acac6cf5e30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:26.950673 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f74094b6-c93a-4dd9-9471-2acac6cf5e30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:26.957108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f74094b6-c93a-4dd9-9471-2acac6cf5e30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:26.963096 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f74094b6-c93a-4dd9-9471-2acac6cf5e30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:26.963096 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f74094b6-c93a-4dd9-9471-2acac6cf5e30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:26.963096 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f74094b6-c93a-4dd9-9471-2acac6cf5e30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:27.040358 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-24eb4126-a14b-4211-ba8f-937c14b62c52 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:27.048436 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-24eb4126-a14b-4211-ba8f-937c14b62c52 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1555 microversion: 2.1 time: 0.157518 May 16 15:20:27.051981 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 312/620] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:26 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:27.090124 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f74094b6-c93a-4dd9-9471-2acac6cf5e30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:27.097380 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f74094b6-c93a-4dd9-9471-2acac6cf5e30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1672 microversion: 2.1 time: 0.152476 May 16 15:20:27.097945 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 309/621] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:26 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:28.066436 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3e97d4cc-fc62-4e89-9b5b-d96af7ddc2df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:28.067044 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3e97d4cc-fc62-4e89-9b5b-d96af7ddc2df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:28.073507 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e97d4cc-fc62-4e89-9b5b-d96af7ddc2df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:28.073945 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e97d4cc-fc62-4e89-9b5b-d96af7ddc2df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:28.074751 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e97d4cc-fc62-4e89-9b5b-d96af7ddc2df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:28.075185 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e97d4cc-fc62-4e89-9b5b-d96af7ddc2df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:28.114853 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5d6cf176-65f4-4b68-b148-110028fcb290 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:28.115584 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5d6cf176-65f4-4b68-b148-110028fcb290 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:28.121882 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5d6cf176-65f4-4b68-b148-110028fcb290 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:28.122386 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5d6cf176-65f4-4b68-b148-110028fcb290 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:28.123163 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5d6cf176-65f4-4b68-b148-110028fcb290 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:28.123601 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5d6cf176-65f4-4b68-b148-110028fcb290 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:28.203834 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3e97d4cc-fc62-4e89-9b5b-d96af7ddc2df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:28.211126 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3e97d4cc-fc62-4e89-9b5b-d96af7ddc2df tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1555 microversion: 2.1 time: 0.148467 May 16 15:20:28.211689 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 313/622] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:28 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:28.248921 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5d6cf176-65f4-4b68-b148-110028fcb290 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:28.256137 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5d6cf176-65f4-4b68-b148-110028fcb290 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1672 microversion: 2.1 time: 0.145107 May 16 15:20:28.256700 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 310/623] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:28 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1672 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:29.228452 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9ad65360-7a61-41bf-a3fc-4e9ff9450774 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:29.228982 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9ad65360-7a61-41bf-a3fc-4e9ff9450774 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:29.235236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ad65360-7a61-41bf-a3fc-4e9ff9450774 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:29.235675 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ad65360-7a61-41bf-a3fc-4e9ff9450774 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:29.236423 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ad65360-7a61-41bf-a3fc-4e9ff9450774 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:29.236849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ad65360-7a61-41bf-a3fc-4e9ff9450774 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:29.272508 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c8b7cadd-f7de-417e-ab0a-c8742b3c9ef1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:29.273111 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c8b7cadd-f7de-417e-ab0a-c8742b3c9ef1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:29.279562 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c8b7cadd-f7de-417e-ab0a-c8742b3c9ef1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:29.280005 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c8b7cadd-f7de-417e-ab0a-c8742b3c9ef1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:29.280771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c8b7cadd-f7de-417e-ab0a-c8742b3c9ef1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:29.281200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c8b7cadd-f7de-417e-ab0a-c8742b3c9ef1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:29.363261 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9ad65360-7a61-41bf-a3fc-4e9ff9450774 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:29.370920 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9ad65360-7a61-41bf-a3fc-4e9ff9450774 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1555 microversion: 2.1 time: 0.146417 May 16 15:20:29.371487 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 314/624] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:29 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:29.414487 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c8b7cadd-f7de-417e-ab0a-c8742b3c9ef1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:29.421763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c8b7cadd-f7de-417e-ab0a-c8742b3c9ef1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1672 microversion: 2.1 time: 0.152987 May 16 15:20:29.422364 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 311/625] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:29 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:29.660257 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-66ad6e4a-5cb4-418f-aadf-e811565ff4ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:29.661281 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-66ad6e4a-5cb4-418f-aadf-e811565ff4ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:29.667129 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66ad6e4a-5cb4-418f-aadf-e811565ff4ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:29.667579 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66ad6e4a-5cb4-418f-aadf-e811565ff4ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:29.668350 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66ad6e4a-5cb4-418f-aadf-e811565ff4ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:29.668783 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66ad6e4a-5cb4-418f-aadf-e811565ff4ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:29.746762 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-66ad6e4a-5cb4-418f-aadf-e811565ff4ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lazy-loading 'services' on Instance uuid f78dee55-4357-4bb4-8057-ddecdd7326f6 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:30.029108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-66ad6e4a-5cb4-418f-aadf-e811565ff4ad tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments/0632c8ba-912c-4809-bfb6-faaf605c405d" status: 202 len: 0 microversion: 2.1 time: 0.372575 May 16 15:20:30.029772 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 315/626] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:20:29 2022] DELETE /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments/0632c8ba-912c-4809-bfb6-faaf605c405d => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:20:30.037970 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f6705b93-7656-4421-ab30-98d45937c7fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:30.038973 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f6705b93-7656-4421-ab30-98d45937c7fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:30.044930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6705b93-7656-4421-ab30-98d45937c7fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:30.045371 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6705b93-7656-4421-ab30-98d45937c7fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:30.046154 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6705b93-7656-4421-ab30-98d45937c7fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:30.046583 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6705b93-7656-4421-ab30-98d45937c7fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:30.075793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f6705b93-7656-4421-ab30-98d45937c7fd tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041752 May 16 15:20:30.076360 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 312/627] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:30 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:30.389366 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c27c99e5-363c-4cbd-8f71-eb07ce9b12b0 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:30.390109 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c27c99e5-363c-4cbd-8f71-eb07ce9b12b0 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:30.396302 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c27c99e5-363c-4cbd-8f71-eb07ce9b12b0 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:30.396753 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c27c99e5-363c-4cbd-8f71-eb07ce9b12b0 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:30.397582 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c27c99e5-363c-4cbd-8f71-eb07ce9b12b0 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:30.398018 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c27c99e5-363c-4cbd-8f71-eb07ce9b12b0 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:30.439615 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8e9e7a1c-f10c-47f2-9665-9b3a9f3c7328 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:30.440230 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8e9e7a1c-f10c-47f2-9665-9b3a9f3c7328 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:30.447749 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e9e7a1c-f10c-47f2-9665-9b3a9f3c7328 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:30.448214 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e9e7a1c-f10c-47f2-9665-9b3a9f3c7328 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:30.449046 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e9e7a1c-f10c-47f2-9665-9b3a9f3c7328 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:30.449482 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e9e7a1c-f10c-47f2-9665-9b3a9f3c7328 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:30.538764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c27c99e5-363c-4cbd-8f71-eb07ce9b12b0 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:30.546943 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c27c99e5-363c-4cbd-8f71-eb07ce9b12b0 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1555 microversion: 2.1 time: 0.162177 May 16 15:20:30.547805 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 316/628] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:30 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:30.595766 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8e9e7a1c-f10c-47f2-9665-9b3a9f3c7328 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:30.603792 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8e9e7a1c-f10c-47f2-9665-9b3a9f3c7328 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1672 microversion: 2.1 time: 0.168142 May 16 15:20:30.604353 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 313/629] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:30 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:31.087740 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bde9ad8d-2104-4d28-bd37-a6d3ab9e3bb1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:31.088776 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bde9ad8d-2104-4d28-bd37-a6d3ab9e3bb1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:31.094768 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bde9ad8d-2104-4d28-bd37-a6d3ab9e3bb1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:31.095228 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bde9ad8d-2104-4d28-bd37-a6d3ab9e3bb1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:31.096006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bde9ad8d-2104-4d28-bd37-a6d3ab9e3bb1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:31.096447 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bde9ad8d-2104-4d28-bd37-a6d3ab9e3bb1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:31.124824 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bde9ad8d-2104-4d28-bd37-a6d3ab9e3bb1 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041544 May 16 15:20:31.125623 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 317/630] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:31 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:31.564101 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-149affd7-d47a-4fef-8a9c-ea40d11c81b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:31.588160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-149affd7-d47a-4fef-8a9c-ea40d11c81b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:31.588160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-149affd7-d47a-4fef-8a9c-ea40d11c81b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:31.588160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-149affd7-d47a-4fef-8a9c-ea40d11c81b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:31.588160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-149affd7-d47a-4fef-8a9c-ea40d11c81b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:31.588565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-149affd7-d47a-4fef-8a9c-ea40d11c81b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:31.610181 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-19f6ec80-7509-46fe-bc3d-0d9485081ae4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:31.610685 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-19f6ec80-7509-46fe-bc3d-0d9485081ae4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:31.618690 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19f6ec80-7509-46fe-bc3d-0d9485081ae4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:31.619134 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19f6ec80-7509-46fe-bc3d-0d9485081ae4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:31.621787 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19f6ec80-7509-46fe-bc3d-0d9485081ae4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:31.621787 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19f6ec80-7509-46fe-bc3d-0d9485081ae4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:31.648906 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-19f6ec80-7509-46fe-bc3d-0d9485081ae4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/ips" status: 200 len: 151 microversion: 2.1 time: 0.164171 May 16 15:20:31.648906 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 314/631] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 16 15:20:31 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/ips => generated 151 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:31.651971 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2de36c8f-6d94-4aa7-b6d2-a8447e6205b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:31.652581 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2de36c8f-6d94-4aa7-b6d2-a8447e6205b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:31.659415 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2de36c8f-6d94-4aa7-b6d2-a8447e6205b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:31.659739 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2de36c8f-6d94-4aa7-b6d2-a8447e6205b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:31.660626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2de36c8f-6d94-4aa7-b6d2-a8447e6205b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:31.661060 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2de36c8f-6d94-4aa7-b6d2-a8447e6205b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:31.738741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2de36c8f-6d94-4aa7-b6d2-a8447e6205b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:31.749202 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2de36c8f-6d94-4aa7-b6d2-a8447e6205b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1606 microversion: 2.1 time: 0.100230 May 16 15:20:31.750022 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 315/632] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:31 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1606 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:31.969362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-149affd7-d47a-4fef-8a9c-ea40d11c81b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:31.978800 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-149affd7-d47a-4fef-8a9c-ea40d11c81b4 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1555 microversion: 2.1 time: 0.418856 May 16 15:20:31.979910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 318/633] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:31 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1555 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:32.136900 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3297b05f-1b08-4f7c-a8db-0378ba27db84 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:32.137832 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3297b05f-1b08-4f7c-a8db-0378ba27db84 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:32.144462 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3297b05f-1b08-4f7c-a8db-0378ba27db84 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:32.144914 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3297b05f-1b08-4f7c-a8db-0378ba27db84 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:32.145698 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3297b05f-1b08-4f7c-a8db-0378ba27db84 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:32.146275 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-19496fa5-3773-4b95-8d80-ef5bffb6fc09 req-5c77f2c1-c12e-46a6-88c0-43c42e3c3f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e68f7e-80df-470a-869e-8c625ab4709c", "name": "network-vif-deleted", "tag": "c2d12348-be99-4d8a-833b-0746887f6b11"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:32.147766 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3297b05f-1b08-4f7c-a8db-0378ba27db84 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:32.158882 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-19496fa5-3773-4b95-8d80-ef5bffb6fc09 req-5c77f2c1-c12e-46a6-88c0-43c42e3c3f48 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:32.159378 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-19496fa5-3773-4b95-8d80-ef5bffb6fc09 req-5c77f2c1-c12e-46a6-88c0-43c42e3c3f48 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:32.179217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-19496fa5-3773-4b95-8d80-ef5bffb6fc09 req-5c77f2c1-c12e-46a6-88c0-43c42e3c3f48 service nova] Creating event network-vif-deleted:c2d12348-be99-4d8a-833b-0746887f6b11 for instance f3e68f7e-80df-470a-869e-8c625ab4709c on hv-cinder-79578 May 16 15:20:32.185497 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-19496fa5-3773-4b95-8d80-ef5bffb6fc09 req-5c77f2c1-c12e-46a6-88c0-43c42e3c3f48 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044984 May 16 15:20:32.186927 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 319/634] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:32.188631 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3297b05f-1b08-4f7c-a8db-0378ba27db84 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056260 May 16 15:20:32.189310 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 316/635] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:32 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:32.775822 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-503adbd0-5480-4c42-a8b6-4eb0b5641018 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:32.775822 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-503adbd0-5480-4c42-a8b6-4eb0b5641018 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:32.776954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-503adbd0-5480-4c42-a8b6-4eb0b5641018 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:32.778095 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-503adbd0-5480-4c42-a8b6-4eb0b5641018 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:32.779638 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-503adbd0-5480-4c42-a8b6-4eb0b5641018 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:32.780378 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-503adbd0-5480-4c42-a8b6-4eb0b5641018 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:32.818963 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-503adbd0-5480-4c42-a8b6-4eb0b5641018 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:32.819540 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-503adbd0-5480-4c42-a8b6-4eb0b5641018 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:32.820080 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-503adbd0-5480-4c42-a8b6-4eb0b5641018 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lazy-loading 'fault' on Instance uuid f3e68f7e-80df-470a-869e-8c625ab4709c {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:32.868232 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-503adbd0-5480-4c42-a8b6-4eb0b5641018 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:32.876322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-503adbd0-5480-4c42-a8b6-4eb0b5641018 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 200 len: 1327 microversion: 2.1 time: 0.113029 May 16 15:20:32.877010 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 320/636] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:32 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:32.996022 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-60ed3e2c-8de6-4de4-8512-a6c0ae78aa36 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:32.997930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-60ed3e2c-8de6-4de4-8512-a6c0ae78aa36 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:33.013319 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60ed3e2c-8de6-4de4-8512-a6c0ae78aa36 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.016441 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60ed3e2c-8de6-4de4-8512-a6c0ae78aa36 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.016441 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60ed3e2c-8de6-4de4-8512-a6c0ae78aa36 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.016441 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60ed3e2c-8de6-4de4-8512-a6c0ae78aa36 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.046783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60ed3e2c-8de6-4de4-8512-a6c0ae78aa36 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.047267 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-60ed3e2c-8de6-4de4-8512-a6c0ae78aa36 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.047729 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-60ed3e2c-8de6-4de4-8512-a6c0ae78aa36 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lazy-loading 'fault' on Instance uuid f2587084-89a0-47a8-909d-019d48b12e5c {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:33.092501 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-60ed3e2c-8de6-4de4-8512-a6c0ae78aa36 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064ef0ac470b458ba5a675364f9cab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18afd7d9815342c196be824d2b99d537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:33.102281 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-60ed3e2c-8de6-4de4-8512-a6c0ae78aa36 tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 200 len: 1349 microversion: 2.1 time: 0.110353 May 16 15:20:33.102866 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 317/637] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:32 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 1349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:33.199804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fecd86fa-faaa-46c2-8c4a-4c119a8e2508 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:33.200987 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fecd86fa-faaa-46c2-8c4a-4c119a8e2508 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:33.207017 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fecd86fa-faaa-46c2-8c4a-4c119a8e2508 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.207473 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fecd86fa-faaa-46c2-8c4a-4c119a8e2508 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.208255 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fecd86fa-faaa-46c2-8c4a-4c119a8e2508 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.208697 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fecd86fa-faaa-46c2-8c4a-4c119a8e2508 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.239834 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fecd86fa-faaa-46c2-8c4a-4c119a8e2508 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044241 May 16 15:20:33.240407 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 321/638] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:33 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:20:33.313966 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-490f5b0a-0fbc-4624-a382-44c52e20d3d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:33.319260 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-490f5b0a-0fbc-4624-a382-44c52e20d3d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:33.320715 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-490f5b0a-0fbc-4624-a382-44c52e20d3d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.321164 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-490f5b0a-0fbc-4624-a382-44c52e20d3d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.322190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-490f5b0a-0fbc-4624-a382-44c52e20d3d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.322650 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-490f5b0a-0fbc-4624-a382-44c52e20d3d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.354607 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-490f5b0a-0fbc-4624-a382-44c52e20d3d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:20:33.433268 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0f6f8b82-a4e5-4d14-a6a5-e2c7b6e455ea tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08666324-773f-4bb3-83fc-34942517a67c"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:33.433268 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0f6f8b82-a4e5-4d14-a6a5-e2c7b6e455ea tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:33.435895 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f6f8b82-a4e5-4d14-a6a5-e2c7b6e455ea tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.436430 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f6f8b82-a4e5-4d14-a6a5-e2c7b6e455ea tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.437399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f6f8b82-a4e5-4d14-a6a5-e2c7b6e455ea tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.438095 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f6f8b82-a4e5-4d14-a6a5-e2c7b6e455ea tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.614959 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-490f5b0a-0fbc-4624-a382-44c52e20d3d7 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 204 len: 0 microversion: 2.1 time: 0.305115 May 16 15:20:33.615793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 318/639] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:20:33 2022] DELETE /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:20:33.624889 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-86b7f091-b562-4ac0-a730-f318efc30dfb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:33.625582 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-86b7f091-b562-4ac0-a730-f318efc30dfb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:33.635498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-86b7f091-b562-4ac0-a730-f318efc30dfb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.635498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-86b7f091-b562-4ac0-a730-f318efc30dfb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.635498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-86b7f091-b562-4ac0-a730-f318efc30dfb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.635498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-86b7f091-b562-4ac0-a730-f318efc30dfb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.765253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-86b7f091-b562-4ac0-a730-f318efc30dfb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:33.772835 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-86b7f091-b562-4ac0-a730-f318efc30dfb tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1689 microversion: 2.1 time: 0.152516 May 16 15:20:33.774175 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 319/640] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:33 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:33.897748 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5895b6a1-993a-44b6-a551-5a3c2868d2b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:33.898477 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5895b6a1-993a-44b6-a551-5a3c2868d2b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:33.904407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5895b6a1-993a-44b6-a551-5a3c2868d2b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.904963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5895b6a1-993a-44b6-a551-5a3c2868d2b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.905733 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5895b6a1-993a-44b6-a551-5a3c2868d2b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:33.906247 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5895b6a1-993a-44b6-a551-5a3c2868d2b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:33.919162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-5895b6a1-993a-44b6-a551-5a3c2868d2b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] HTTP exception thrown: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5895b6a1-993a-44b6-a551-5a3c2868d2b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Request method failure captured: May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c HTTP/1.1 May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqNr8Y2YNiGnPWwSwaoFcHssAT1-6Q5vev-2iY8r4SvqLz7G_ENUXfRFhESH5tATu1IuNdkrIV4RFv6v9RBXVAs64cGo_csl4PPeEYXaFMT3AW_yGf2XNKygGcVpihvYrL3gc-IifgEHg9nhI7_Gd9cSwT69tUqboU63hhakcbRm8A May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:20:33.929963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9703f082240542aa979c6b53052d77b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9703f082240542aa979c6b53052d77b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeTestJSON-419811486 May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeTestJSON-419811486-project May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 911ef817a1ee4790ad97e857a299fb01 May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeTestJSON-419811486-project May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:20:33.931598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': 'f3e68f7e-80df-470a-869e-8c625ab4709c'} May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:20:33.932496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:20:33.934012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:33.935373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5895b6a1-993a-44b6-a551-5a3c2868d2b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Returning 404 to user: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:20:33.935373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5895b6a1-993a-44b6-a551-5a3c2868d2b4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 404 len: 111 microversion: 2.1 time: 0.028998 May 16 15:20:33.935373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 320/641] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:33 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:20:33.935373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b1410f75-3f24-41cb-8f01-f96f296f454e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '.version_select at 0x7fc9a6c7d940>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:34.045250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b1410f75-3f24-41cb-8f01-f96f296f454e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598819362" status: 202 len: 0 microversion: 2.1 time: 0.117632 May 16 15:20:34.046535 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 321/642] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 16 15:20:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598819362 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 15:20:34.119714 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-36ef2947-a52e-4c4e-834a-38566d4266ed tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:34.120323 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-36ef2947-a52e-4c4e-834a-38566d4266ed tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] [instance: f2587084-89a0-47a8-909d-019d48b12e5c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:34.128158 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36ef2947-a52e-4c4e-834a-38566d4266ed tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:34.128615 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36ef2947-a52e-4c4e-834a-38566d4266ed tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:34.129392 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36ef2947-a52e-4c4e-834a-38566d4266ed tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:34.129835 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36ef2947-a52e-4c4e-834a-38566d4266ed tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:34.143821 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-36ef2947-a52e-4c4e-834a-38566d4266ed tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] HTTP exception thrown: Instance f2587084-89a0-47a8-909d-019d48b12e5c could not be found. May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-36ef2947-a52e-4c4e-834a-38566d4266ed tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Request method failure captured: May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c HTTP/1.1 May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmrtzAFKavX8DTWzumkNe0hhmG5DDs2HAS5ZqHwq5gfdpBIOPfq7bzATQvE2bBGfNVKSXA2IK-_KpmyuaYOBKmZ1HFghEniut7Oxbm-wnMY5MGsh2mYiPcg3LGi-GhDSNDKjaFD3xgWB_85Di6ndVa8XhdxKAYtR6J3RyiSX0d_9tz8 May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: 18afd7d9815342c196be824d2b99d537 May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-TestMinimumBasicScenario-1692797995 May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:20:34.145474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/18afd7d9815342c196be824d2b99d537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/18afd7d9815342c196be824d2b99d537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/18afd7d9815342c196be824d2b99d537"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_18afd7d9815342c196be824d2b99d537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-TestMinimumBasicScenario-1692797995 May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 18afd7d9815342c196be824d2b99d537 May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1692797995 May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-TestMinimumBasicScenario-1692797995-project May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 064ef0ac470b458ba5a675364f9cab31 May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-TestMinimumBasicScenario-1692797995-project May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance f2587084-89a0-47a8-909d-019d48b12e5c could not be found. May 16 15:20:34.147105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': 'f2587084-89a0-47a8-909d-019d48b12e5c'} May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2587084-89a0-47a8-909d-019d48b12e5c could not be found. May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:20:34.148000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2587084-89a0-47a8-909d-019d48b12e5c could not be found. May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2587084-89a0-47a8-909d-019d48b12e5c could not be found. May 16 15:20:34.149354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:34.150706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-36ef2947-a52e-4c4e-834a-38566d4266ed tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Returning 404 to user: Instance f2587084-89a0-47a8-909d-019d48b12e5c could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:20:34.150706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-36ef2947-a52e-4c4e-834a-38566d4266ed tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c" status: 404 len: 111 microversion: 2.1 time: 0.031288 May 16 15:20:34.150706 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 322/643] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:34 2022] GET /compute/v2.1/servers/f2587084-89a0-47a8-909d-019d48b12e5c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:20:34.156044 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2b2b610e-299a-4803-b8fd-fe3fc47d36db tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] Calling method '.version_select at 0x7fc9a6e3f040>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:34.257019 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2b2b610e-299a-4803-b8fd-fe3fc47d36db tempest-TestMinimumBasicScenario-1692797995 tempest-TestMinimumBasicScenario-1692797995-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1203983110" status: 202 len: 0 microversion: 2.1 time: 0.105057 May 16 15:20:34.257606 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 323/644] 10.222.0.44 () {58 vars in 1271 bytes} [Mon May 16 15:20:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1203983110 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 15:20:34.262074 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-e1f2b390-56d3-4517-bc01-7e7f5981977b req-5e548f2e-1a13-4b5f-8131-c3a12de72583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2587084-89a0-47a8-909d-019d48b12e5c", "name": "network-vif-deleted", "tag": "3904bae9-9274-4a0f-8757-bdbf49cf6aff"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:34.278725 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-e1f2b390-56d3-4517-bc01-7e7f5981977b req-5e548f2e-1a13-4b5f-8131-c3a12de72583 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:34.279250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-e1f2b390-56d3-4517-bc01-7e7f5981977b req-5e548f2e-1a13-4b5f-8131-c3a12de72583 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:34.294516 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-e1f2b390-56d3-4517-bc01-7e7f5981977b req-5e548f2e-1a13-4b5f-8131-c3a12de72583 service nova] Creating event network-vif-deleted:3904bae9-9274-4a0f-8757-bdbf49cf6aff for instance f2587084-89a0-47a8-909d-019d48b12e5c on hv-cinder-79578 May 16 15:20:34.302182 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-e1f2b390-56d3-4517-bc01-7e7f5981977b req-5e548f2e-1a13-4b5f-8131-c3a12de72583 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043299 May 16 15:20:34.303660 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 324/645] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:34.789856 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-34767188-fafe-43ad-9f69-b920578f9384 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:34.790574 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-34767188-fafe-43ad-9f69-b920578f9384 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:34.797215 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34767188-fafe-43ad-9f69-b920578f9384 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:34.802219 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34767188-fafe-43ad-9f69-b920578f9384 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:34.802219 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34767188-fafe-43ad-9f69-b920578f9384 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:34.802219 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34767188-fafe-43ad-9f69-b920578f9384 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:34.932343 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-34767188-fafe-43ad-9f69-b920578f9384 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:34.940420 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-34767188-fafe-43ad-9f69-b920578f9384 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1689 microversion: 2.1 time: 0.154787 May 16 15:20:34.941006 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 325/646] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:34 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:34.945417 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-404f5721-69f0-431c-b532-1bf7d1e8e2bd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Action: 'create', calling method: .version_select at 0x7fc9a6c58d30>, body: {"keypair": {"name": "tempest-keypair-1162943271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6HkpCKmIYhW73M6DPqFzAjE8c3Atuz88Wz4LLxsJoYFjUBnT05WNo17LEEORH/rTuofoj5a4PSO9JB47vaHozXX9ZWvU8WXc4T9AbNB59rr+2n7GGSuyVWp0qDMy9HQQ=="}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:34.959454 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-404f5721-69f0-431c-b532-1bf7d1e8e2bd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Getting quotas for project 9703f082240542aa979c6b53052d77b9. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:20:34.963181 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-404f5721-69f0-431c-b532-1bf7d1e8e2bd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Getting quotas for user 911ef817a1ee4790ad97e857a299fb01 and project 9703f082240542aa979c6b53052d77b9. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:20:35.041374 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-404f5721-69f0-431c-b532-1bf7d1e8e2bd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099351 May 16 15:20:35.041983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 326/647] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 16 15:20:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:35.048427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6a221b83-e5fc-4402-ab28-c1464e26c0cd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:35.048971 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6a221b83-e5fc-4402-ab28-c1464e26c0cd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:35.057503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a221b83-e5fc-4402-ab28-c1464e26c0cd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:35.058392 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a221b83-e5fc-4402-ab28-c1464e26c0cd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:35.058828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a221b83-e5fc-4402-ab28-c1464e26c0cd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:35.059261 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6a221b83-e5fc-4402-ab28-c1464e26c0cd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:35.141829 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-6a221b83-e5fc-4402-ab28-c1464e26c0cd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lazy-loading 'services' on Instance uuid e5abda4a-52f9-4b01-9c65-675397422c41 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:35.365913 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6a221b83-e5fc-4402-ab28-c1464e26c0cd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41/os-volume_attachments/912d2879-2599-400a-8dec-b3989fbf9a11" status: 202 len: 0 microversion: 2.1 time: 0.322573 May 16 15:20:35.367103 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 327/648] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:20:35 2022] DELETE /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41/os-volume_attachments/912d2879-2599-400a-8dec-b3989fbf9a11 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:20:35.958263 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cf197826-80c9-485f-a8f7-99919ea17079 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:35.958963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cf197826-80c9-485f-a8f7-99919ea17079 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:35.965251 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cf197826-80c9-485f-a8f7-99919ea17079 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:35.965702 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cf197826-80c9-485f-a8f7-99919ea17079 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:35.966496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cf197826-80c9-485f-a8f7-99919ea17079 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:35.966934 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cf197826-80c9-485f-a8f7-99919ea17079 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:36.434605 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cf197826-80c9-485f-a8f7-99919ea17079 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:36.443542 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cf197826-80c9-485f-a8f7-99919ea17079 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1689 microversion: 2.1 time: 0.490397 May 16 15:20:36.444335 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 328/649] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:35 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1689 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:37.402490 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0f6f8b82-a4e5-4d14-a6a5-e2c7b6e455ea tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.980806 May 16 15:20:37.407792 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 322/650] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:20:33 2022] POST /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments => generated 194 bytes in 3983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:20:37.474752 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cba5534a-5500-429f-88ae-81564da334d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:37.475356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cba5534a-5500-429f-88ae-81564da334d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:37.483395 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cba5534a-5500-429f-88ae-81564da334d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:37.483843 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cba5534a-5500-429f-88ae-81564da334d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:37.484612 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cba5534a-5500-429f-88ae-81564da334d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:37.485044 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cba5534a-5500-429f-88ae-81564da334d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:37.510204 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-721145077", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20dfff89-2b4c-4d06-bcfc-8ec2e202af64"}], "security_groups": [{"name": "tempest-securitygroup--131389704"}], "key_name": "tempest-keypair-1162943271", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:37.715979 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] validate_networks() for [('20dfff89-2b4c-4d06-bcfc-8ec2e202af64', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:20:37.822910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cba5534a-5500-429f-88ae-81564da334d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:37.835317 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cba5534a-5500-429f-88ae-81564da334d9 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1689 microversion: 2.1 time: 0.377966 May 16 15:20:37.836658 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 329/651] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:37 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1689 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:38.495302 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:20:38.495302 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:20:38.495755 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:20:38.495842 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:20:38.496243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:20:38.507598 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:38.508055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:38.508891 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:38.509364 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:38.528140 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Getting quotas for project 9703f082240542aa979c6b53052d77b9. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:20:38.532200 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Getting quotas for user 911ef817a1ee4790ad97e857a299fb01 and project 9703f082240542aa979c6b53052d77b9. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:20:38.543382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:20:38.545752 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:20:38.685552 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e634a68d-a721-4982-bfd6-2f19db62bbf2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:38.686913 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e634a68d-a721-4982-bfd6-2f19db62bbf2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:38.695985 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e634a68d-a721-4982-bfd6-2f19db62bbf2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:38.696820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e634a68d-a721-4982-bfd6-2f19db62bbf2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:38.697775 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e634a68d-a721-4982-bfd6-2f19db62bbf2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:38.698438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e634a68d-a721-4982-bfd6-2f19db62bbf2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:38.704034 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-85380d5a-5ce1-4000-98e0-c7894671b96a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.198323 May 16 15:20:38.704931 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 323/652] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:20:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:20:38.715376 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-987852a4-0b56-4fc1-9bdf-49bf67407a64 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:38.716336 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-987852a4-0b56-4fc1-9bdf-49bf67407a64 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:38.730931 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e634a68d-a721-4982-bfd6-2f19db62bbf2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:20:38.865690 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-987852a4-0b56-4fc1-9bdf-49bf67407a64 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:38.876455 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-987852a4-0b56-4fc1-9bdf-49bf67407a64 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1237 microversion: 2.1 time: 0.163105 May 16 15:20:38.878844 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 324/653] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:38 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1237 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:38.899694 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7fde9972-f369-4787-a10f-ac167d8a8a72 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:38.900366 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7fde9972-f369-4787-a10f-ac167d8a8a72 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:38.908781 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fde9972-f369-4787-a10f-ac167d8a8a72 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:38.909674 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fde9972-f369-4787-a10f-ac167d8a8a72 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:38.910844 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fde9972-f369-4787-a10f-ac167d8a8a72 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:38.911417 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fde9972-f369-4787-a10f-ac167d8a8a72 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:39.046986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7fde9972-f369-4787-a10f-ac167d8a8a72 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:39.061877 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7fde9972-f369-4787-a10f-ac167d8a8a72 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1621 microversion: 2.1 time: 0.175520 May 16 15:20:39.064118 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 325/654] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:38 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1621 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:39.076288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-ce90b794-39ea-4676-9e91-cf0f301812dc req-b81a5180-6d60-4e78-8c0f-2c2245e80c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78dee55-4357-4bb4-8057-ddecdd7326f6", "name": "network-vif-deleted", "tag": "0a775fd5-0c4b-4d34-8fea-0665c23c121b"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:39.098652 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e634a68d-a721-4982-bfd6-2f19db62bbf2 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 204 len: 0 microversion: 2.1 time: 0.419750 May 16 15:20:39.099701 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 330/655] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:20:38 2022] DELETE /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 15:20:39.108503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-da1f819b-7bb9-48b6-9e38-834192ff03be tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:39.109042 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-da1f819b-7bb9-48b6-9e38-834192ff03be tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:39.112079 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ce90b794-39ea-4676-9e91-cf0f301812dc req-b81a5180-6d60-4e78-8c0f-2c2245e80c66 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:39.112576 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ce90b794-39ea-4676-9e91-cf0f301812dc req-b81a5180-6d60-4e78-8c0f-2c2245e80c66 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:39.126863 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da1f819b-7bb9-48b6-9e38-834192ff03be tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:39.127321 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da1f819b-7bb9-48b6-9e38-834192ff03be tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:39.128116 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da1f819b-7bb9-48b6-9e38-834192ff03be tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:39.128554 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da1f819b-7bb9-48b6-9e38-834192ff03be tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:39.142690 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-ce90b794-39ea-4676-9e91-cf0f301812dc req-b81a5180-6d60-4e78-8c0f-2c2245e80c66 service nova] Creating event network-vif-deleted:0a775fd5-0c4b-4d34-8fea-0665c23c121b for instance f78dee55-4357-4bb4-8057-ddecdd7326f6 on hv-cinder-79578 May 16 15:20:39.158792 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-ce90b794-39ea-4676-9e91-cf0f301812dc req-b81a5180-6d60-4e78-8c0f-2c2245e80c66 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093141 May 16 15:20:39.162544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 326/656] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:39.404398 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-da1f819b-7bb9-48b6-9e38-834192ff03be tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:39.413440 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-da1f819b-7bb9-48b6-9e38-834192ff03be tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1513 microversion: 2.1 time: 0.309417 May 16 15:20:39.415897 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 331/657] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:39 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:39.898794 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2148403e-04ca-4edb-b58d-3b5afcaad58a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:39.900406 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2148403e-04ca-4edb-b58d-3b5afcaad58a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:39.963966 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2148403e-04ca-4edb-b58d-3b5afcaad58a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:39.970942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2148403e-04ca-4edb-b58d-3b5afcaad58a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1237 microversion: 2.1 time: 0.079082 May 16 15:20:39.971515 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 327/658] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:39 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:40.081051 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-40726b24-c6f7-4502-840f-94ac53dea789 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:40.082356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-40726b24-c6f7-4502-840f-94ac53dea789 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:40.089548 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40726b24-c6f7-4502-840f-94ac53dea789 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:40.090472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40726b24-c6f7-4502-840f-94ac53dea789 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:40.091359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40726b24-c6f7-4502-840f-94ac53dea789 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:40.091886 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40726b24-c6f7-4502-840f-94ac53dea789 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:40.124941 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40726b24-c6f7-4502-840f-94ac53dea789 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:40.125532 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40726b24-c6f7-4502-840f-94ac53dea789 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:40.126199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-40726b24-c6f7-4502-840f-94ac53dea789 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lazy-loading 'fault' on Instance uuid f78dee55-4357-4bb4-8057-ddecdd7326f6 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:40.174372 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-40726b24-c6f7-4502-840f-94ac53dea789 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:40.186077 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-40726b24-c6f7-4502-840f-94ac53dea789 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1335 microversion: 2.1 time: 0.108029 May 16 15:20:40.186598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 332/659] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:40 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:40.430805 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-452c2a06-a2a5-4715-ac98-c6de79a0c3d1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:40.431433 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-452c2a06-a2a5-4715-ac98-c6de79a0c3d1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:40.442127 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-452c2a06-a2a5-4715-ac98-c6de79a0c3d1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:40.442770 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-452c2a06-a2a5-4715-ac98-c6de79a0c3d1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:40.443706 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-452c2a06-a2a5-4715-ac98-c6de79a0c3d1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:40.444297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-452c2a06-a2a5-4715-ac98-c6de79a0c3d1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:40.581212 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-452c2a06-a2a5-4715-ac98-c6de79a0c3d1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:40.590939 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-452c2a06-a2a5-4715-ac98-c6de79a0c3d1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1513 microversion: 2.1 time: 0.163877 May 16 15:20:40.598331 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 328/660] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:40 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:40.988890 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-31d2ee8b-e228-447c-9d1d-a40de2625855 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:40.989709 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-31d2ee8b-e228-447c-9d1d-a40de2625855 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:40.997398 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31d2ee8b-e228-447c-9d1d-a40de2625855 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:41.002940 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31d2ee8b-e228-447c-9d1d-a40de2625855 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:41.009409 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31d2ee8b-e228-447c-9d1d-a40de2625855 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:41.010274 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31d2ee8b-e228-447c-9d1d-a40de2625855 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:41.203199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b3eb67e4-0438-49ce-857f-6dfe9469660c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:41.203855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b3eb67e4-0438-49ce-857f-6dfe9469660c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:41.219739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3eb67e4-0438-49ce-857f-6dfe9469660c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:41.220234 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3eb67e4-0438-49ce-857f-6dfe9469660c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:41.222047 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3eb67e4-0438-49ce-857f-6dfe9469660c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:41.222546 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3eb67e4-0438-49ce-857f-6dfe9469660c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:41.275567 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3eb67e4-0438-49ce-857f-6dfe9469660c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:41.276310 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3eb67e4-0438-49ce-857f-6dfe9469660c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:41.276922 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-b3eb67e4-0438-49ce-857f-6dfe9469660c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lazy-loading 'fault' on Instance uuid f78dee55-4357-4bb4-8057-ddecdd7326f6 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:41.330637 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b3eb67e4-0438-49ce-857f-6dfe9469660c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:41.340059 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b3eb67e4-0438-49ce-857f-6dfe9469660c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 200 len: 1335 microversion: 2.1 time: 0.140939 May 16 15:20:41.349331 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 329/661] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:41 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 1335 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:41.350533 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-31d2ee8b-e228-447c-9d1d-a40de2625855 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:41.360856 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-31d2ee8b-e228-447c-9d1d-a40de2625855 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1233 microversion: 2.1 time: 0.375928 May 16 15:20:41.361747 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 333/662] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:40 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1233 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:41.620614 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-28cc2a81-1ce8-4029-9d6d-0ad2df7b791f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:41.621355 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-28cc2a81-1ce8-4029-9d6d-0ad2df7b791f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:41.631289 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-28cc2a81-1ce8-4029-9d6d-0ad2df7b791f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:41.631803 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-28cc2a81-1ce8-4029-9d6d-0ad2df7b791f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:41.632593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-28cc2a81-1ce8-4029-9d6d-0ad2df7b791f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:41.636336 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-a1f07a5d-bfd3-4427-a4d7-288bd7c35db7 req-bf6d6631-82cb-4214-8067-b183b047ea78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5abda4a-52f9-4b01-9c65-675397422c41", "name": "network-vif-deleted", "tag": "e096f6ef-c70e-4e67-b7f3-eb68492a38f7"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:41.649301 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-28cc2a81-1ce8-4029-9d6d-0ad2df7b791f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:41.663757 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a1f07a5d-bfd3-4427-a4d7-288bd7c35db7 req-bf6d6631-82cb-4214-8067-b183b047ea78 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:41.664210 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a1f07a5d-bfd3-4427-a4d7-288bd7c35db7 req-bf6d6631-82cb-4214-8067-b183b047ea78 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:41.689580 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-a1f07a5d-bfd3-4427-a4d7-288bd7c35db7 req-bf6d6631-82cb-4214-8067-b183b047ea78 service nova] Creating event network-vif-deleted:e096f6ef-c70e-4e67-b7f3-eb68492a38f7 for instance e5abda4a-52f9-4b01-9c65-675397422c41 on hv-cinder-79578 May 16 15:20:41.703444 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-a1f07a5d-bfd3-4427-a4d7-288bd7c35db7 req-bf6d6631-82cb-4214-8067-b183b047ea78 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072445 May 16 15:20:41.704627 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 334/663] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:41.737108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-28cc2a81-1ce8-4029-9d6d-0ad2df7b791f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:41.762155 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-28cc2a81-1ce8-4029-9d6d-0ad2df7b791f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 200 len: 1471 microversion: 2.1 time: 0.157104 May 16 15:20:41.762887 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 330/664] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:41 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:42.358152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3590daff-3aae-4e50-8b15-e8dec97a7f5f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:42.359593 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3590daff-3aae-4e50-8b15-e8dec97a7f5f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: f78dee55-4357-4bb4-8057-ddecdd7326f6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:42.368497 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3590daff-3aae-4e50-8b15-e8dec97a7f5f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:42.369269 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3590daff-3aae-4e50-8b15-e8dec97a7f5f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:42.370383 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3590daff-3aae-4e50-8b15-e8dec97a7f5f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:42.371042 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3590daff-3aae-4e50-8b15-e8dec97a7f5f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:42.377840 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-10f49f44-ee99-4827-8a2c-bd5d8c8b3cf7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:42.380439 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-10f49f44-ee99-4827-8a2c-bd5d8c8b3cf7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:42.392059 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10f49f44-ee99-4827-8a2c-bd5d8c8b3cf7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:42.392059 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10f49f44-ee99-4827-8a2c-bd5d8c8b3cf7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:42.392059 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10f49f44-ee99-4827-8a2c-bd5d8c8b3cf7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:42.392059 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10f49f44-ee99-4827-8a2c-bd5d8c8b3cf7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:42.409872 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-3590daff-3aae-4e50-8b15-e8dec97a7f5f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] HTTP exception thrown: Instance f78dee55-4357-4bb4-8057-ddecdd7326f6 could not be found. May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3590daff-3aae-4e50-8b15-e8dec97a7f5f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Request method failure captured: May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 HTTP/1.1 May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqK54J41Q5ZxL_QyU-Q-VZdGq9UCScERyQ6w5yYqjVfeWLE0oqK7Gtv2tI5XRhcO1owfgkx6gaoy5Peo_zqyhv_hAxXy3uv_aE0iP8V5OUb4aJoKYMnErP71VH-vqCJkoqC0-9pCtMo-qvAEAPKOEkdMYHcMu8OjF3oWoy4aipwXlQ May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: 316917d7a31645bfaac651f81154c18f May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:20:42.420656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/316917d7a31645bfaac651f81154c18f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/316917d7a31645bfaac651f81154c18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/316917d7a31645bfaac651f81154c18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_316917d7a31645bfaac651f81154c18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 316917d7a31645bfaac651f81154c18f May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-ServerRescueNegativeTestJSON-1789909565-project May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: a14795cb97ac44b2a7fc1e2f79b12253 May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1789909565-project May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance f78dee55-4357-4bb4-8057-ddecdd7326f6 could not be found. May 16 15:20:42.422217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': 'f78dee55-4357-4bb4-8057-ddecdd7326f6'} May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f78dee55-4357-4bb4-8057-ddecdd7326f6 could not be found. May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:20:42.423017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f78dee55-4357-4bb4-8057-ddecdd7326f6 could not be found. May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f78dee55-4357-4bb4-8057-ddecdd7326f6 could not be found. May 16 15:20:42.424390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:20:42.427151 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3590daff-3aae-4e50-8b15-e8dec97a7f5f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Returning 404 to user: Instance f78dee55-4357-4bb4-8057-ddecdd7326f6 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:20:42.428230 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3590daff-3aae-4e50-8b15-e8dec97a7f5f tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6" status: 404 len: 111 microversion: 2.1 time: 0.075309 May 16 15:20:42.431981 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 335/665] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:42 2022] GET /compute/v2.1/servers/f78dee55-4357-4bb4-8057-ddecdd7326f6 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:20:42.446202 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2eeb324b-b0f4-4069-89e7-8bcdfff31576 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '.version_select at 0x7fc9a6bd3160>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:42.521804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-10f49f44-ee99-4827-8a2c-bd5d8c8b3cf7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:42.532586 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-10f49f44-ee99-4827-8a2c-bd5d8c8b3cf7 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1295 microversion: 2.1 time: 0.158776 May 16 15:20:42.533512 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 331/666] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:42 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1295 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:42.599852 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2eeb324b-b0f4-4069-89e7-8bcdfff31576 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-198345449" status: 202 len: 0 microversion: 2.1 time: 0.163135 May 16 15:20:42.601214 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 336/667] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 16 15:20:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-198345449 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:20:42.783446 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a38f9fca-03c2-4097-a15e-9368193eb793 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:42.783446 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a38f9fca-03c2-4097-a15e-9368193eb793 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: e5abda4a-52f9-4b01-9c65-675397422c41] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:42.787029 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a38f9fca-03c2-4097-a15e-9368193eb793 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:42.788630 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a38f9fca-03c2-4097-a15e-9368193eb793 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:42.793162 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a38f9fca-03c2-4097-a15e-9368193eb793 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:42.793823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a38f9fca-03c2-4097-a15e-9368193eb793 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:42.824206 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-a38f9fca-03c2-4097-a15e-9368193eb793 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] HTTP exception thrown: Instance e5abda4a-52f9-4b01-9c65-675397422c41 could not be found. May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a38f9fca-03c2-4097-a15e-9368193eb793 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Request method failure captured: May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 HTTP/1.1 May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmuDd_3xn91aOuJjFAcgCsFvdwu4R0x8ajvCZfg_ZhSbMj3dc71fAmy6g9T4MP23xbo_EbY8xonBdegSo3fo4M0EKW912vi4IGJ8i1t46zFo8f6boA8kcYIv9BTyWTAFrYVFHC6ay2v1ncO0iGOQfE2XrYo_6B74_jUA_10uEVAh-Aw May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: f6ec3267b0c548558b92318ec6179dca May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2054816046 May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:20:42.825890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6ec3267b0c548558b92318ec6179dca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f6ec3267b0c548558b92318ec6179dca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6ec3267b0c548558b92318ec6179dca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f6ec3267b0c548558b92318ec6179dca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesSnapshotTestJSON-2054816046 May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: f6ec3267b0c548558b92318ec6179dca May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2054816046 May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesSnapshotTestJSON-2054816046-project May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: d9e6e8acac7c447ba3885dcafb386050 May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesSnapshotTestJSON-2054816046-project May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance e5abda4a-52f9-4b01-9c65-675397422c41 could not be found. May 16 15:20:42.827352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'e5abda4a-52f9-4b01-9c65-675397422c41'} May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5abda4a-52f9-4b01-9c65-675397422c41 could not be found. May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:20:42.828145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5abda4a-52f9-4b01-9c65-675397422c41 could not be found. May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5abda4a-52f9-4b01-9c65-675397422c41 could not be found. May 16 15:20:42.829362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:42.831441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a38f9fca-03c2-4097-a15e-9368193eb793 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Returning 404 to user: Instance e5abda4a-52f9-4b01-9c65-675397422c41 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:20:42.831441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a38f9fca-03c2-4097-a15e-9368193eb793 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41" status: 404 len: 111 microversion: 2.1 time: 0.051181 May 16 15:20:42.845186 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 332/668] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:42 2022] GET /compute/v2.1/servers/e5abda4a-52f9-4b01-9c65-675397422c41 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:20:43.554826 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-84c5431c-2063-481f-9f53-5234f3026877 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:43.554826 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-84c5431c-2063-481f-9f53-5234f3026877 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:43.558071 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-84c5431c-2063-481f-9f53-5234f3026877 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:43.558634 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-84c5431c-2063-481f-9f53-5234f3026877 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:43.559509 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-84c5431c-2063-481f-9f53-5234f3026877 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:43.560054 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-84c5431c-2063-481f-9f53-5234f3026877 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:43.813433 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-84c5431c-2063-481f-9f53-5234f3026877 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:43.823003 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-84c5431c-2063-481f-9f53-5234f3026877 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.277625 May 16 15:20:43.840325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 337/669] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:43 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:44.299689 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-ebc2420e-5cd6-414e-a8d2-e4672b82c13d req-c8a922a3-fd1a-4da3-828b-12f2d7ecab04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981657e2-4b25-4a25-a9eb-562cdeb9efd6", "tag": "3df0b4b3-062a-4219-b9ab-a32600518c32"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:44.311051 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ebc2420e-5cd6-414e-a8d2-e4672b82c13d req-c8a922a3-fd1a-4da3-828b-12f2d7ecab04 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:44.311772 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ebc2420e-5cd6-414e-a8d2-e4672b82c13d req-c8a922a3-fd1a-4da3-828b-12f2d7ecab04 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:44.324877 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-ebc2420e-5cd6-414e-a8d2-e4672b82c13d req-c8a922a3-fd1a-4da3-828b-12f2d7ecab04 service nova] Creating event network-changed:3df0b4b3-062a-4219-b9ab-a32600518c32 for instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 on hv-cinder-79578 May 16 15:20:44.330264 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-ebc2420e-5cd6-414e-a8d2-e4672b82c13d req-c8a922a3-fd1a-4da3-828b-12f2d7ecab04 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034168 May 16 15:20:44.331128 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 333/670] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:44.840558 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-92906757-aa8a-47e6-a4e4-8ef390ae71a6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:44.841108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-92906757-aa8a-47e6-a4e4-8ef390ae71a6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:44.847449 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92906757-aa8a-47e6-a4e4-8ef390ae71a6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:44.847908 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92906757-aa8a-47e6-a4e4-8ef390ae71a6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:44.848654 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92906757-aa8a-47e6-a4e4-8ef390ae71a6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:44.849079 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92906757-aa8a-47e6-a4e4-8ef390ae71a6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:44.992606 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-92906757-aa8a-47e6-a4e4-8ef390ae71a6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:45.001502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-92906757-aa8a-47e6-a4e4-8ef390ae71a6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.165089 May 16 15:20:45.004498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 338/671] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:44 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:46.020427 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-98c982d7-4473-406a-8f07-697de4747089 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:46.021116 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-98c982d7-4473-406a-8f07-697de4747089 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:46.027262 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98c982d7-4473-406a-8f07-697de4747089 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:46.027715 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98c982d7-4473-406a-8f07-697de4747089 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:46.028557 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98c982d7-4473-406a-8f07-697de4747089 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:46.028986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98c982d7-4473-406a-8f07-697de4747089 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:46.157205 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-98c982d7-4473-406a-8f07-697de4747089 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:46.164440 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-98c982d7-4473-406a-8f07-697de4747089 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.148691 May 16 15:20:46.165004 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 334/672] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:46 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:47.181189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-af85cd6b-500b-48b9-a190-82bac7ea7429 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:47.181965 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-af85cd6b-500b-48b9-a190-82bac7ea7429 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:47.188337 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-af85cd6b-500b-48b9-a190-82bac7ea7429 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:47.188783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-af85cd6b-500b-48b9-a190-82bac7ea7429 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:47.189545 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-af85cd6b-500b-48b9-a190-82bac7ea7429 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:47.189971 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-af85cd6b-500b-48b9-a190-82bac7ea7429 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:47.322851 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-af85cd6b-500b-48b9-a190-82bac7ea7429 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:47.331421 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-af85cd6b-500b-48b9-a190-82bac7ea7429 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.154010 May 16 15:20:47.332023 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 339/673] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:47 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:48.242495 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc9f55fb-6d02-4e48-b770-055d57ada0ec tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08666324-773f-4bb3-83fc-34942517a67c"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:48.243562 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cc9f55fb-6d02-4e48-b770-055d57ada0ec tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:48.249817 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc9f55fb-6d02-4e48-b770-055d57ada0ec tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.250301 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc9f55fb-6d02-4e48-b770-055d57ada0ec tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.251068 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc9f55fb-6d02-4e48-b770-055d57ada0ec tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.251502 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc9f55fb-6d02-4e48-b770-055d57ada0ec tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.327853 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-cc9f55fb-6d02-4e48-b770-055d57ada0ec tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Invalid volume: volume 08666324-773f-4bb3-83fc-34942517a67c is already attached to instances: 7914c5a4-73f7-4114-a4ec-d583fecff5ec May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc9f55fb-6d02-4e48-b770-055d57ada0ec tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: POST /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments HTTP/1.1 May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 74 May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:20:48.329592 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {"volumeAttachment": {"volumeId": "08666324-773f-4bb3-83fc-34942517a67c"}} May 16 15:20:48.332696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Invalid volume: volume 08666324-773f-4bb3-83fc-34942517a67c is already attached to instances: 7914c5a4-73f7-4114-a4ec-d583fecff5ec May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'server_id': '7914c5a4-73f7-4114-a4ec-d583fecff5ec', 'body': {'volumeAttachment': {'volumeId': '08666324-773f-4bb3-83fc-34942517a67c'}}} May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 08666324-773f-4bb3-83fc-34942517a67c is already attached to instances: 7914c5a4-73f7-4114-a4ec-d583fecff5ec May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:48.333605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 08666324-773f-4bb3-83fc-34942517a67c is already attached to instances: 7914c5a4-73f7-4114-a4ec-d583fecff5ec May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:48.335023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:48.336463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:48.336463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:20:48.336463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:20:48.336463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 08666324-773f-4bb3-83fc-34942517a67c is already attached to instances: 7914c5a4-73f7-4114-a4ec-d583fecff5ec May 16 15:20:48.336463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:48.336463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc9f55fb-6d02-4e48-b770-055d57ada0ec tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 400 to user: Invalid volume: volume 08666324-773f-4bb3-83fc-34942517a67c is already attached to instances: 7914c5a4-73f7-4114-a4ec-d583fecff5ec {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:20:48.336463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cc9f55fb-6d02-4e48-b770-055d57ada0ec tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092771 May 16 15:20:48.336463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 335/674] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:20:48 2022] POST /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:20:48.348774 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b4f183e9-0227-40e3-aa4c-b9966da8af37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:48.349450 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b4f183e9-0227-40e3-aa4c-b9966da8af37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:48.356112 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4f183e9-0227-40e3-aa4c-b9966da8af37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.356558 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4f183e9-0227-40e3-aa4c-b9966da8af37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.357334 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4f183e9-0227-40e3-aa4c-b9966da8af37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.358504 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4f183e9-0227-40e3-aa4c-b9966da8af37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.391380 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-595aba7c-acf0-4301-bc7c-6874c3788d1b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:48.391867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-595aba7c-acf0-4301-bc7c-6874c3788d1b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:48.398915 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-595aba7c-acf0-4301-bc7c-6874c3788d1b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.399373 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-595aba7c-acf0-4301-bc7c-6874c3788d1b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.400132 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-595aba7c-acf0-4301-bc7c-6874c3788d1b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.400562 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-595aba7c-acf0-4301-bc7c-6874c3788d1b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.480031 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-595aba7c-acf0-4301-bc7c-6874c3788d1b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lazy-loading 'services' on Instance uuid 7914c5a4-73f7-4114-a4ec-d583fecff5ec {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:48.487336 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b4f183e9-0227-40e3-aa4c-b9966da8af37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:48.494669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b4f183e9-0227-40e3-aa4c-b9966da8af37 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.149753 May 16 15:20:48.495225 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 340/675] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:48 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:48.646820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-38269555-1b43-43c3-96d3-f38575a99888 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:48.647345 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-38269555-1b43-43c3-96d3-f38575a99888 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:48.653247 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38269555-1b43-43c3-96d3-f38575a99888 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.653685 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38269555-1b43-43c3-96d3-f38575a99888 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.654472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38269555-1b43-43c3-96d3-f38575a99888 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.655535 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38269555-1b43-43c3-96d3-f38575a99888 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.679069 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-38269555-1b43-43c3-96d3-f38575a99888 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:20:48.699413 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-595aba7c-acf0-4301-bc7c-6874c3788d1b tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments/08666324-773f-4bb3-83fc-34942517a67c" status: 202 len: 0 microversion: 2.1 time: 0.311957 May 16 15:20:48.700182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 336/676] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:20:48 2022] DELETE /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments/08666324-773f-4bb3-83fc-34942517a67c => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:20:48.710268 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-afff044f-46a5-4e0a-b390-7bffdd542716 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:48.711325 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-afff044f-46a5-4e0a-b390-7bffdd542716 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:48.718897 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afff044f-46a5-4e0a-b390-7bffdd542716 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.719362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afff044f-46a5-4e0a-b390-7bffdd542716 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.720130 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afff044f-46a5-4e0a-b390-7bffdd542716 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.720603 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afff044f-46a5-4e0a-b390-7bffdd542716 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.752352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-afff044f-46a5-4e0a-b390-7bffdd542716 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046428 May 16 15:20:48.752976 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 337/677] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:48 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:48.923172 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-38269555-1b43-43c3-96d3-f38575a99888 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "DELETE /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 204 len: 0 microversion: 2.1 time: 0.279903 May 16 15:20:48.923758 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 341/678] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:20:48 2022] DELETE /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 15:20:48.931696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-afb55d34-b9e1-4491-bd35-cc78c5a59aa3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:48.932305 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-afb55d34-b9e1-4491-bd35-cc78c5a59aa3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:48.938702 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afb55d34-b9e1-4491-bd35-cc78c5a59aa3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.939147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afb55d34-b9e1-4491-bd35-cc78c5a59aa3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:48.939910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afb55d34-b9e1-4491-bd35-cc78c5a59aa3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:48.940346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afb55d34-b9e1-4491-bd35-cc78c5a59aa3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:49.077738 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-afb55d34-b9e1-4491-bd35-cc78c5a59aa3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:49.085182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-afb55d34-b9e1-4491-bd35-cc78c5a59aa3 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1509 microversion: 2.1 time: 0.157297 May 16 15:20:49.085775 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 338/679] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:48 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:49.512351 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-24a5aa53-d6d5-4fb0-b936-d17a17120a9b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:49.512962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-24a5aa53-d6d5-4fb0-b936-d17a17120a9b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:49.519406 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24a5aa53-d6d5-4fb0-b936-d17a17120a9b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:49.519852 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24a5aa53-d6d5-4fb0-b936-d17a17120a9b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:49.520622 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24a5aa53-d6d5-4fb0-b936-d17a17120a9b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:49.521096 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24a5aa53-d6d5-4fb0-b936-d17a17120a9b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:49.650206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-24a5aa53-d6d5-4fb0-b936-d17a17120a9b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:49.657909 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-24a5aa53-d6d5-4fb0-b936-d17a17120a9b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.149883 May 16 15:20:49.658524 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 342/680] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:49 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:49.763841 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cf2b1d01-7a4a-4fe9-9bda-4c25ce4b0d24 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:49.764695 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cf2b1d01-7a4a-4fe9-9bda-4c25ce4b0d24 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:49.771492 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf2b1d01-7a4a-4fe9-9bda-4c25ce4b0d24 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:49.771934 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf2b1d01-7a4a-4fe9-9bda-4c25ce4b0d24 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:49.772689 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf2b1d01-7a4a-4fe9-9bda-4c25ce4b0d24 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:49.773113 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf2b1d01-7a4a-4fe9-9bda-4c25ce4b0d24 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:49.800995 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cf2b1d01-7a4a-4fe9-9bda-4c25ce4b0d24 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041080 May 16 15:20:49.801580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 339/681] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:49 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:50.101625 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3d9c51e5-5281-48c6-b9a3-22ebb9fea033 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:50.102318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3d9c51e5-5281-48c6-b9a3-22ebb9fea033 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:50.108237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3d9c51e5-5281-48c6-b9a3-22ebb9fea033 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:50.108687 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3d9c51e5-5281-48c6-b9a3-22ebb9fea033 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:50.109457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3d9c51e5-5281-48c6-b9a3-22ebb9fea033 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:50.110467 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3d9c51e5-5281-48c6-b9a3-22ebb9fea033 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:50.234007 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3d9c51e5-5281-48c6-b9a3-22ebb9fea033 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:50.241748 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3d9c51e5-5281-48c6-b9a3-22ebb9fea033 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1509 microversion: 2.1 time: 0.143926 May 16 15:20:50.242349 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 343/682] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:50 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1509 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:50.674529 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1e400b94-b022-40d2-a98c-25938059d041 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:50.675139 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1e400b94-b022-40d2-a98c-25938059d041 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:50.681070 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e400b94-b022-40d2-a98c-25938059d041 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:50.681522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e400b94-b022-40d2-a98c-25938059d041 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:50.682316 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e400b94-b022-40d2-a98c-25938059d041 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:50.682756 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e400b94-b022-40d2-a98c-25938059d041 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:50.806597 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1e400b94-b022-40d2-a98c-25938059d041 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:50.812769 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-198df7ef-9738-4196-8931-cb397380e89f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:50.814333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-198df7ef-9738-4196-8931-cb397380e89f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:50.814790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1e400b94-b022-40d2-a98c-25938059d041 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.144701 May 16 15:20:50.815360 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 340/683] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:50 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:50.820658 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-198df7ef-9738-4196-8931-cb397380e89f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:50.821102 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-198df7ef-9738-4196-8931-cb397380e89f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:50.821870 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-198df7ef-9738-4196-8931-cb397380e89f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:50.822328 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-198df7ef-9738-4196-8931-cb397380e89f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:50.850755 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-198df7ef-9738-4196-8931-cb397380e89f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042279 May 16 15:20:50.851308 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 344/684] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:50 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:51.258993 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-32ce77ab-68ce-4a84-bb04-ac151e18b3c5 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:51.259593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-32ce77ab-68ce-4a84-bb04-ac151e18b3c5 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:51.265520 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32ce77ab-68ce-4a84-bb04-ac151e18b3c5 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:51.265964 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32ce77ab-68ce-4a84-bb04-ac151e18b3c5 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:51.266755 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32ce77ab-68ce-4a84-bb04-ac151e18b3c5 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:51.267186 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32ce77ab-68ce-4a84-bb04-ac151e18b3c5 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:51.390112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-32ce77ab-68ce-4a84-bb04-ac151e18b3c5 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:51.397288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-32ce77ab-68ce-4a84-bb04-ac151e18b3c5 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1509 microversion: 2.1 time: 0.142160 May 16 15:20:51.397853 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 341/685] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:51 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:51.831652 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f18c9748-5e08-4bc8-8c7b-5afdd0b1d086 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:51.832253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f18c9748-5e08-4bc8-8c7b-5afdd0b1d086 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:51.840713 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f18c9748-5e08-4bc8-8c7b-5afdd0b1d086 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:51.841161 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f18c9748-5e08-4bc8-8c7b-5afdd0b1d086 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:51.841917 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f18c9748-5e08-4bc8-8c7b-5afdd0b1d086 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:51.842379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f18c9748-5e08-4bc8-8c7b-5afdd0b1d086 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:51.862594 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-67100cb6-91d1-4024-92e8-0b09b6738e5a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:51.863590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-67100cb6-91d1-4024-92e8-0b09b6738e5a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:51.869801 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67100cb6-91d1-4024-92e8-0b09b6738e5a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:51.870291 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67100cb6-91d1-4024-92e8-0b09b6738e5a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:51.871044 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67100cb6-91d1-4024-92e8-0b09b6738e5a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:51.871481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67100cb6-91d1-4024-92e8-0b09b6738e5a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:51.900876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-67100cb6-91d1-4024-92e8-0b09b6738e5a tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042532 May 16 15:20:51.901349 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 342/686] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:51 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:20:51.970977 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f18c9748-5e08-4bc8-8c7b-5afdd0b1d086 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:51.978082 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f18c9748-5e08-4bc8-8c7b-5afdd0b1d086 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.150275 May 16 15:20:51.978657 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 345/687] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:51 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:52.415098 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-04cdbf1a-2dd6-4205-9a1b-a74eaa6808f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:52.415724 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-04cdbf1a-2dd6-4205-9a1b-a74eaa6808f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:52.421591 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04cdbf1a-2dd6-4205-9a1b-a74eaa6808f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:52.422296 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04cdbf1a-2dd6-4205-9a1b-a74eaa6808f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:52.423108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04cdbf1a-2dd6-4205-9a1b-a74eaa6808f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:52.423544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04cdbf1a-2dd6-4205-9a1b-a74eaa6808f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:52.554493 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-04cdbf1a-2dd6-4205-9a1b-a74eaa6808f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:52.561875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-04cdbf1a-2dd6-4205-9a1b-a74eaa6808f4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1509 microversion: 2.1 time: 0.150709 May 16 15:20:52.562474 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 343/688] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:52 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:52.912408 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-830a2f2f-5049-42ef-a8c9-1d20d807a11c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:52.913344 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-830a2f2f-5049-42ef-a8c9-1d20d807a11c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:52.919768 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-830a2f2f-5049-42ef-a8c9-1d20d807a11c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:52.920225 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-830a2f2f-5049-42ef-a8c9-1d20d807a11c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:52.921003 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-830a2f2f-5049-42ef-a8c9-1d20d807a11c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:52.921442 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-830a2f2f-5049-42ef-a8c9-1d20d807a11c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:52.949555 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-830a2f2f-5049-42ef-a8c9-1d20d807a11c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041112 May 16 15:20:52.950261 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 346/689] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:20:52 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:20:52.997177 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-60fc4520-a228-4cce-8f6b-7629edb48af9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:52.998084 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-60fc4520-a228-4cce-8f6b-7629edb48af9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:53.006165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60fc4520-a228-4cce-8f6b-7629edb48af9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.006639 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60fc4520-a228-4cce-8f6b-7629edb48af9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.007420 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60fc4520-a228-4cce-8f6b-7629edb48af9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.007990 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60fc4520-a228-4cce-8f6b-7629edb48af9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.012346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e6404774-adac-47df-830b-cd0127c38f04 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:53.012851 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e6404774-adac-47df-830b-cd0127c38f04 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:53.019304 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e6404774-adac-47df-830b-cd0127c38f04 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.019758 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e6404774-adac-47df-830b-cd0127c38f04 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.020530 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e6404774-adac-47df-830b-cd0127c38f04 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.020968 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e6404774-adac-47df-830b-cd0127c38f04 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.046889 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e6404774-adac-47df-830b-cd0127c38f04 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:20:53.230218 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-60fc4520-a228-4cce-8f6b-7629edb48af9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:53.239019 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-60fc4520-a228-4cce-8f6b-7629edb48af9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.246926 May 16 15:20:53.239599 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 344/690] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:52 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:53.337782 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e6404774-adac-47df-830b-cd0127c38f04 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 204 len: 0 microversion: 2.1 time: 0.328827 May 16 15:20:53.338634 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 347/691] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:20:53 2022] DELETE /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 15:20:53.343970 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1104145225", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "networks": [{"uuid": "52443307-02f5-4e57-bece-5c1fc6d7aa3e"}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:53.379846 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-96606fef-17d7-47e6-8f06-208810d0c64c req-e703034e-ed0b-443c-a341-159f1c12c34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766a2d7d-3279-4c55-9dfb-29746e7fd0f0", "name": "network-vif-deleted", "tag": "478148b0-c270-4a3b-8603-9ce967e01679"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:53.391725 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-96606fef-17d7-47e6-8f06-208810d0c64c req-e703034e-ed0b-443c-a341-159f1c12c34e service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.392491 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-96606fef-17d7-47e6-8f06-208810d0c64c req-e703034e-ed0b-443c-a341-159f1c12c34e service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.396827 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] validate_networks() for [('52443307-02f5-4e57-bece-5c1fc6d7aa3e', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:20:53.403378 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-96606fef-17d7-47e6-8f06-208810d0c64c req-e703034e-ed0b-443c-a341-159f1c12c34e service nova] Creating event network-vif-deleted:478148b0-c270-4a3b-8603-9ce967e01679 for instance 766a2d7d-3279-4c55-9dfb-29746e7fd0f0 on hv-cinder-79578 May 16 15:20:53.409359 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-96606fef-17d7-47e6-8f06-208810d0c64c req-e703034e-ed0b-443c-a341-159f1c12c34e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159295 May 16 15:20:53.409951 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 345/692] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:53.420008 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-38abc863-7b95-403f-821e-c2ff587bdc6d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:53.420008 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-38abc863-7b95-403f-821e-c2ff587bdc6d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:53.421997 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38abc863-7b95-403f-821e-c2ff587bdc6d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.422474 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38abc863-7b95-403f-821e-c2ff587bdc6d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.423269 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38abc863-7b95-403f-821e-c2ff587bdc6d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.423698 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38abc863-7b95-403f-821e-c2ff587bdc6d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.568787 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-38abc863-7b95-403f-821e-c2ff587bdc6d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:53.578791 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-38abc863-7b95-403f-821e-c2ff587bdc6d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1679 microversion: 2.1 time: 0.167515 May 16 15:20:53.579602 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 346/693] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:53 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:53.584392 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7c2caa84-23bc-4bf4-9af4-4d73e3c295af tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:53.585405 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7c2caa84-23bc-4bf4-9af4-4d73e3c295af tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:53.592167 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c2caa84-23bc-4bf4-9af4-4d73e3c295af tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.592627 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c2caa84-23bc-4bf4-9af4-4d73e3c295af tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.593423 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c2caa84-23bc-4bf4-9af4-4d73e3c295af tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.593866 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c2caa84-23bc-4bf4-9af4-4d73e3c295af tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.666001 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7c2caa84-23bc-4bf4-9af4-4d73e3c295af tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:53.673498 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7c2caa84-23bc-4bf4-9af4-4d73e3c295af tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1293 microversion: 2.1 time: 0.092738 May 16 15:20:53.674081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 347/694] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:53 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:53.847770 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:20:53.848188 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:20:53.848658 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:20:53.849062 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:20:53.849471 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:20:53.858736 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.859180 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.859976 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:53.860409 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:53.876267 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Getting quotas for project f6ec3267b0c548558b92318ec6179dca. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:20:53.880092 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Getting quotas for user d9e6e8acac7c447ba3885dcafb386050 and project f6ec3267b0c548558b92318ec6179dca. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:20:53.890465 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:20:53.892704 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:20:54.031830 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-db88c37d-d756-4ca1-be15-6d4b6a9ee4bc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691850 May 16 15:20:54.033221 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 348/695] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:20:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:20:54.043160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3e0cc7b7-a9ff-4c64-b2ca-3d7e620bc3e3 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:54.043879 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3e0cc7b7-a9ff-4c64-b2ca-3d7e620bc3e3 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:54.099627 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3e0cc7b7-a9ff-4c64-b2ca-3d7e620bc3e3 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:54.106409 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3e0cc7b7-a9ff-4c64-b2ca-3d7e620bc3e3 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1219 microversion: 2.1 time: 0.067081 May 16 15:20:54.107180 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 348/696] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:54 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:54.256640 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-519b5ce6-439b-4da2-b461-acbb2a1cd984 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:54.257259 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-519b5ce6-439b-4da2-b461-acbb2a1cd984 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:54.263367 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-519b5ce6-439b-4da2-b461-acbb2a1cd984 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:54.263811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-519b5ce6-439b-4da2-b461-acbb2a1cd984 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:54.264767 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-519b5ce6-439b-4da2-b461-acbb2a1cd984 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:54.265207 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-519b5ce6-439b-4da2-b461-acbb2a1cd984 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:54.335739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-b3f69ff3-a661-459d-b9bf-5029f6259c9b req-33cb82de-68ff-4f36-aeb1-3e5bdf7d534e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981657e2-4b25-4a25-a9eb-562cdeb9efd6", "name": "network-vif-plugged", "status": "completed", "tag": "3df0b4b3-062a-4219-b9ab-a32600518c32"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:54.354333 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-b3f69ff3-a661-459d-b9bf-5029f6259c9b req-33cb82de-68ff-4f36-aeb1-3e5bdf7d534e service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:54.354774 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-b3f69ff3-a661-459d-b9bf-5029f6259c9b req-33cb82de-68ff-4f36-aeb1-3e5bdf7d534e service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:54.374204 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-b3f69ff3-a661-459d-b9bf-5029f6259c9b req-33cb82de-68ff-4f36-aeb1-3e5bdf7d534e service nova] Creating event network-vif-plugged:3df0b4b3-062a-4219-b9ab-a32600518c32 for instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 on hv-cinder-79578 May 16 15:20:54.388337 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-b3f69ff3-a661-459d-b9bf-5029f6259c9b req-33cb82de-68ff-4f36-aeb1-3e5bdf7d534e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112817 May 16 15:20:54.388956 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 349/697] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:54.402846 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-519b5ce6-439b-4da2-b461-acbb2a1cd984 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:54.411553 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-519b5ce6-439b-4da2-b461-acbb2a1cd984 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.159425 May 16 15:20:54.412131 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 349/698] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:54 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:54.596689 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5acbbfeb-f891-4876-b1c1-05cb22a786b9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:54.597386 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5acbbfeb-f891-4876-b1c1-05cb22a786b9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:54.603673 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5acbbfeb-f891-4876-b1c1-05cb22a786b9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:54.604146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5acbbfeb-f891-4876-b1c1-05cb22a786b9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:54.604945 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5acbbfeb-f891-4876-b1c1-05cb22a786b9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:54.605381 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5acbbfeb-f891-4876-b1c1-05cb22a786b9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:54.690111 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-40c7ec3a-37bd-47ae-b197-906d79c51eb4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:54.691426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-40c7ec3a-37bd-47ae-b197-906d79c51eb4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:54.697786 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40c7ec3a-37bd-47ae-b197-906d79c51eb4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:54.698289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40c7ec3a-37bd-47ae-b197-906d79c51eb4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:54.699057 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40c7ec3a-37bd-47ae-b197-906d79c51eb4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:54.699490 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40c7ec3a-37bd-47ae-b197-906d79c51eb4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:54.734028 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5acbbfeb-f891-4876-b1c1-05cb22a786b9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:54.742738 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5acbbfeb-f891-4876-b1c1-05cb22a786b9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1679 microversion: 2.1 time: 0.150378 May 16 15:20:54.743573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 350/699] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:54 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:54.761106 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-40c7ec3a-37bd-47ae-b197-906d79c51eb4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:54.768372 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-40c7ec3a-37bd-47ae-b197-906d79c51eb4 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1293 microversion: 2.1 time: 0.082108 May 16 15:20:54.768971 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 350/700] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:54 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:55.123391 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6f0f6dea-5c9d-4c62-b032-2658fabfa7fb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:55.124035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6f0f6dea-5c9d-4c62-b032-2658fabfa7fb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:55.130542 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0f6dea-5c9d-4c62-b032-2658fabfa7fb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:55.130990 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0f6dea-5c9d-4c62-b032-2658fabfa7fb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:55.131755 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0f6dea-5c9d-4c62-b032-2658fabfa7fb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:55.132188 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0f6dea-5c9d-4c62-b032-2658fabfa7fb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:55.192472 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6f0f6dea-5c9d-4c62-b032-2658fabfa7fb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:55.199896 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6f0f6dea-5c9d-4c62-b032-2658fabfa7fb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1223 microversion: 2.1 time: 0.080399 May 16 15:20:55.200464 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 351/701] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:55 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:55.428717 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-088c34e0-3caa-4376-be51-80b1901b696a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:55.429863 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-088c34e0-3caa-4376-be51-80b1901b696a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:55.436458 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-088c34e0-3caa-4376-be51-80b1901b696a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:55.436913 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-088c34e0-3caa-4376-be51-80b1901b696a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:55.437699 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-088c34e0-3caa-4376-be51-80b1901b696a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:55.438219 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-088c34e0-3caa-4376-be51-80b1901b696a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:55.581351 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-088c34e0-3caa-4376-be51-80b1901b696a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:55.591902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-088c34e0-3caa-4376-be51-80b1901b696a tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.166997 May 16 15:20:55.592943 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 351/702] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:55 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:55.760107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8282f008-cd86-4ef2-928d-e5a7b9d18302 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:55.760667 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8282f008-cd86-4ef2-928d-e5a7b9d18302 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:55.766638 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8282f008-cd86-4ef2-928d-e5a7b9d18302 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:55.767086 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8282f008-cd86-4ef2-928d-e5a7b9d18302 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:55.767856 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8282f008-cd86-4ef2-928d-e5a7b9d18302 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:55.768302 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8282f008-cd86-4ef2-928d-e5a7b9d18302 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:55.791940 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-18358ef9-d29b-492a-9894-82eddf160000 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:55.792564 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-18358ef9-d29b-492a-9894-82eddf160000 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:55.798831 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18358ef9-d29b-492a-9894-82eddf160000 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:55.799284 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18358ef9-d29b-492a-9894-82eddf160000 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:55.800060 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18358ef9-d29b-492a-9894-82eddf160000 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:55.800507 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18358ef9-d29b-492a-9894-82eddf160000 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:55.834014 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18358ef9-d29b-492a-9894-82eddf160000 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:55.834494 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18358ef9-d29b-492a-9894-82eddf160000 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:55.835397 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-18358ef9-d29b-492a-9894-82eddf160000 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lazy-loading 'fault' on Instance uuid 766a2d7d-3279-4c55-9dfb-29746e7fd0f0 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:55.888045 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-18358ef9-d29b-492a-9894-82eddf160000 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:55.897544 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-18358ef9-d29b-492a-9894-82eddf160000 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 200 len: 1312 microversion: 2.1 time: 0.109268 May 16 15:20:55.905743 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 352/703] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:55 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:55.961609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8282f008-cd86-4ef2-928d-e5a7b9d18302 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:55.969239 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8282f008-cd86-4ef2-928d-e5a7b9d18302 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1679 microversion: 2.1 time: 0.213006 May 16 15:20:55.969810 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 352/704] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:55 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:56.217027 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cd2707ef-97de-459b-aab5-e8aeb0d311c7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:56.217643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cd2707ef-97de-459b-aab5-e8aeb0d311c7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:56.224447 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd2707ef-97de-459b-aab5-e8aeb0d311c7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.230003 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd2707ef-97de-459b-aab5-e8aeb0d311c7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:56.230003 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd2707ef-97de-459b-aab5-e8aeb0d311c7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.230003 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cd2707ef-97de-459b-aab5-e8aeb0d311c7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:56.289916 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cd2707ef-97de-459b-aab5-e8aeb0d311c7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:56.297341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cd2707ef-97de-459b-aab5-e8aeb0d311c7 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1271 microversion: 2.1 time: 0.084475 May 16 15:20:56.297905 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 353/705] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:56 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:56.374194 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-599c5357-8542-40ae-91f4-e4aaf1d48863 req-6c2fdaf5-66e5-4c75-9f0f-39b42f2a82a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7914c5a4-73f7-4114-a4ec-d583fecff5ec", "name": "network-vif-deleted", "tag": "c65d1e07-7d92-45c0-afcb-735f16828214"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:56.382908 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-599c5357-8542-40ae-91f4-e4aaf1d48863 req-6c2fdaf5-66e5-4c75-9f0f-39b42f2a82a3 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.383344 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-599c5357-8542-40ae-91f4-e4aaf1d48863 req-6c2fdaf5-66e5-4c75-9f0f-39b42f2a82a3 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:56.394139 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-599c5357-8542-40ae-91f4-e4aaf1d48863 req-6c2fdaf5-66e5-4c75-9f0f-39b42f2a82a3 service nova] Creating event network-vif-deleted:c65d1e07-7d92-45c0-afcb-735f16828214 for instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec on hv-cinder-79578 May 16 15:20:56.399433 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-599c5357-8542-40ae-91f4-e4aaf1d48863 req-6c2fdaf5-66e5-4c75-9f0f-39b42f2a82a3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028865 May 16 15:20:56.400016 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 353/706] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:56.611019 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a32c7223-15da-46be-9b3c-97e5b1de53e1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:56.612773 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a32c7223-15da-46be-9b3c-97e5b1de53e1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:56.620864 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a32c7223-15da-46be-9b3c-97e5b1de53e1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.621323 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a32c7223-15da-46be-9b3c-97e5b1de53e1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:56.622135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a32c7223-15da-46be-9b3c-97e5b1de53e1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.622790 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a32c7223-15da-46be-9b3c-97e5b1de53e1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:56.763046 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a32c7223-15da-46be-9b3c-97e5b1de53e1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:56.770910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a32c7223-15da-46be-9b3c-97e5b1de53e1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1362 microversion: 2.1 time: 0.164529 May 16 15:20:56.772911 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 354/707] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:56 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:56.915864 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9f5d0333-956d-42bd-9030-87ab191f9cf0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:56.916477 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9f5d0333-956d-42bd-9030-87ab191f9cf0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: 766a2d7d-3279-4c55-9dfb-29746e7fd0f0] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:56.923132 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f5d0333-956d-42bd-9030-87ab191f9cf0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.923571 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f5d0333-956d-42bd-9030-87ab191f9cf0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:56.924342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f5d0333-956d-42bd-9030-87ab191f9cf0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.924800 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f5d0333-956d-42bd-9030-87ab191f9cf0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:56.938349 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-9f5d0333-956d-42bd-9030-87ab191f9cf0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] HTTP exception thrown: Instance 766a2d7d-3279-4c55-9dfb-29746e7fd0f0 could not be found. May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9f5d0333-956d-42bd-9030-87ab191f9cf0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Request method failure captured: May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 HTTP/1.1 May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqK54J41Q5ZxL_QyU-Q-VZdGq9UCScERyQ6w5yYqjVfeWLE0oqK7Gtv2tI5XRhcO1owfgkx6gaoy5Peo_zqyhv_hAxXy3uv_aE0iP8V5OUb4aJoKYMnErP71VH-vqCJkoqC0-9pCtMo-qvAEAPKOEkdMYHcMu8OjF3oWoy4aipwXlQ May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 316917d7a31645bfaac651f81154c18f May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:20:56.939986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/316917d7a31645bfaac651f81154c18f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/316917d7a31645bfaac651f81154c18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/316917d7a31645bfaac651f81154c18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_316917d7a31645bfaac651f81154c18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 316917d7a31645bfaac651f81154c18f May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-ServerRescueNegativeTestJSON-1789909565-project May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: a14795cb97ac44b2a7fc1e2f79b12253 May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1789909565-project May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance 766a2d7d-3279-4c55-9dfb-29746e7fd0f0 could not be found. May 16 15:20:56.941555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '766a2d7d-3279-4c55-9dfb-29746e7fd0f0'} May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766a2d7d-3279-4c55-9dfb-29746e7fd0f0 could not be found. May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:20:56.942559 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766a2d7d-3279-4c55-9dfb-29746e7fd0f0 could not be found. May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766a2d7d-3279-4c55-9dfb-29746e7fd0f0 could not be found. May 16 15:20:56.944050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:20:56.945589 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9f5d0333-956d-42bd-9030-87ab191f9cf0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Returning 404 to user: Instance 766a2d7d-3279-4c55-9dfb-29746e7fd0f0 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:20:56.945589 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9f5d0333-956d-42bd-9030-87ab191f9cf0 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0" status: 404 len: 111 microversion: 2.1 time: 0.030613 May 16 15:20:56.945589 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 354/708] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:56 2022] GET /compute/v2.1/servers/766a2d7d-3279-4c55-9dfb-29746e7fd0f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:20:56.950821 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b226841f-d794-4aac-a312-f459bdf9da5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:56.951317 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b226841f-d794-4aac-a312-f459bdf9da5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:56.958075 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b226841f-d794-4aac-a312-f459bdf9da5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.958554 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b226841f-d794-4aac-a312-f459bdf9da5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:56.959326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b226841f-d794-4aac-a312-f459bdf9da5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.959764 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b226841f-d794-4aac-a312-f459bdf9da5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:56.985166 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b226841f-d794-4aac-a312-f459bdf9da5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:20:56.986813 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ee728c6d-99c9-4281-9fa5-7ce63cb30efe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:56.987417 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ee728c6d-99c9-4281-9fa5-7ce63cb30efe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:56.993976 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee728c6d-99c9-4281-9fa5-7ce63cb30efe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.994467 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee728c6d-99c9-4281-9fa5-7ce63cb30efe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:56.995229 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee728c6d-99c9-4281-9fa5-7ce63cb30efe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:56.997019 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee728c6d-99c9-4281-9fa5-7ce63cb30efe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:57.062436 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee728c6d-99c9-4281-9fa5-7ce63cb30efe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:57.070114 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ee728c6d-99c9-4281-9fa5-7ce63cb30efe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1322 microversion: 2.1 time: 0.087018 May 16 15:20:57.070679 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 355/709] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:56 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:57.265756 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b226841f-d794-4aac-a312-f459bdf9da5c tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 204 len: 0 microversion: 2.1 time: 0.318469 May 16 15:20:57.266517 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 355/710] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:20:56 2022] DELETE /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:20:57.275022 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-825d94cf-c11d-43cc-a693-b7d2449cf98b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:57.275621 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-825d94cf-c11d-43cc-a693-b7d2449cf98b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:57.281453 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-825d94cf-c11d-43cc-a693-b7d2449cf98b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:57.281903 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-825d94cf-c11d-43cc-a693-b7d2449cf98b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:57.282713 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-825d94cf-c11d-43cc-a693-b7d2449cf98b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:57.283143 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-825d94cf-c11d-43cc-a693-b7d2449cf98b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:57.315102 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bd0a4190-4a86-48e5-b7b2-e872651717dd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:57.318343 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bd0a4190-4a86-48e5-b7b2-e872651717dd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:57.325564 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bd0a4190-4a86-48e5-b7b2-e872651717dd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:57.326004 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bd0a4190-4a86-48e5-b7b2-e872651717dd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:57.326841 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bd0a4190-4a86-48e5-b7b2-e872651717dd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:57.327277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bd0a4190-4a86-48e5-b7b2-e872651717dd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:57.410143 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bd0a4190-4a86-48e5-b7b2-e872651717dd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:57.418737 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bd0a4190-4a86-48e5-b7b2-e872651717dd tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1279 microversion: 2.1 time: 0.107606 May 16 15:20:57.419676 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 356/711] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:57 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:57.460178 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-825d94cf-c11d-43cc-a693-b7d2449cf98b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:57.467527 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-825d94cf-c11d-43cc-a693-b7d2449cf98b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.196893 May 16 15:20:57.468097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 356/712] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:57 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:57.787935 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6dde13ca-9ceb-4b48-b060-2814f1e81fcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:57.788599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6dde13ca-9ceb-4b48-b060-2814f1e81fcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:57.795314 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6dde13ca-9ceb-4b48-b060-2814f1e81fcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:57.795761 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6dde13ca-9ceb-4b48-b060-2814f1e81fcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:57.796520 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6dde13ca-9ceb-4b48-b060-2814f1e81fcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:57.796950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6dde13ca-9ceb-4b48-b060-2814f1e81fcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:57.924645 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6dde13ca-9ceb-4b48-b060-2814f1e81fcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:57.933729 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6dde13ca-9ceb-4b48-b060-2814f1e81fcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1548 microversion: 2.1 time: 0.149574 May 16 15:20:57.934378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 357/713] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:57 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:57.949920 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1278bf3a-164a-49ce-8794-3350f196ff6e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:57.950467 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1278bf3a-164a-49ce-8794-3350f196ff6e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:57.956508 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1278bf3a-164a-49ce-8794-3350f196ff6e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:57.956962 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1278bf3a-164a-49ce-8794-3350f196ff6e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:57.957731 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1278bf3a-164a-49ce-8794-3350f196ff6e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:57.958227 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1278bf3a-164a-49ce-8794-3350f196ff6e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:58.034575 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1278bf3a-164a-49ce-8794-3350f196ff6e tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088415 May 16 15:20:58.035176 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 357/714] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 16 15:20:57 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:20:58.086911 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6c6875b0-b538-41d7-8374-a4c3cc548d48 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:58.087526 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6c6875b0-b538-41d7-8374-a4c3cc548d48 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:58.093393 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c6875b0-b538-41d7-8374-a4c3cc548d48 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:58.093841 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c6875b0-b538-41d7-8374-a4c3cc548d48 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:58.094666 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c6875b0-b538-41d7-8374-a4c3cc548d48 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:58.095096 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c6875b0-b538-41d7-8374-a4c3cc548d48 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:58.126579 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c6875b0-b538-41d7-8374-a4c3cc548d48 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:58.127023 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c6875b0-b538-41d7-8374-a4c3cc548d48 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:58.127469 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-6c6875b0-b538-41d7-8374-a4c3cc548d48 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lazy-loading 'fault' on Instance uuid 7914c5a4-73f7-4114-a4ec-d583fecff5ec {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:58.169737 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6c6875b0-b538-41d7-8374-a4c3cc548d48 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:58.177678 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6c6875b0-b538-41d7-8374-a4c3cc548d48 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1327 microversion: 2.1 time: 0.094115 May 16 15:20:58.178474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 358/715] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:58 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:58.436384 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-70f9e3c5-7af1-4e1b-96fc-397e44d1a662 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:58.436998 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-70f9e3c5-7af1-4e1b-96fc-397e44d1a662 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:58.443097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70f9e3c5-7af1-4e1b-96fc-397e44d1a662 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:58.443548 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70f9e3c5-7af1-4e1b-96fc-397e44d1a662 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:58.444321 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70f9e3c5-7af1-4e1b-96fc-397e44d1a662 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:58.444758 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70f9e3c5-7af1-4e1b-96fc-397e44d1a662 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:58.483857 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ee98c9d3-1442-4d17-915e-089368290b23 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:58.484459 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ee98c9d3-1442-4d17-915e-089368290b23 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:58.490257 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ee98c9d3-1442-4d17-915e-089368290b23 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:58.490708 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ee98c9d3-1442-4d17-915e-089368290b23 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:58.491472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ee98c9d3-1442-4d17-915e-089368290b23 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:58.491909 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ee98c9d3-1442-4d17-915e-089368290b23 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:58.589823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70f9e3c5-7af1-4e1b-96fc-397e44d1a662 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:58.600042 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-70f9e3c5-7af1-4e1b-96fc-397e44d1a662 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1331 microversion: 2.1 time: 0.167244 May 16 15:20:58.609754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 358/716] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:58 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1331 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:58.621325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ee98c9d3-1442-4d17-915e-089368290b23 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:58.628931 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ee98c9d3-1442-4d17-915e-089368290b23 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.148866 May 16 15:20:58.629859 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 359/717] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:58 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:20:59.194368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d9773ff7-85e1-44b6-af5c-d09f56a49264 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:59.194897 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d9773ff7-85e1-44b6-af5c-d09f56a49264 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:59.200935 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9773ff7-85e1-44b6-af5c-d09f56a49264 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:59.201382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9773ff7-85e1-44b6-af5c-d09f56a49264 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:59.202173 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9773ff7-85e1-44b6-af5c-d09f56a49264 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:59.202617 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9773ff7-85e1-44b6-af5c-d09f56a49264 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:59.236986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9773ff7-85e1-44b6-af5c-d09f56a49264 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:59.237437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9773ff7-85e1-44b6-af5c-d09f56a49264 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:59.237885 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-d9773ff7-85e1-44b6-af5c-d09f56a49264 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lazy-loading 'fault' on Instance uuid 7914c5a4-73f7-4114-a4ec-d583fecff5ec {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:20:59.276034 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-922d3986-3d92-4116-9ab4-b82bded67bb3 req-ebddcf4c-fc6f-4b66-af70-c4fd238caacd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981657e2-4b25-4a25-a9eb-562cdeb9efd6", "tag": "3df0b4b3-062a-4219-b9ab-a32600518c32"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:20:59.285524 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-922d3986-3d92-4116-9ab4-b82bded67bb3 req-ebddcf4c-fc6f-4b66-af70-c4fd238caacd service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:59.286144 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-922d3986-3d92-4116-9ab4-b82bded67bb3 req-ebddcf4c-fc6f-4b66-af70-c4fd238caacd service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:59.291079 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d9773ff7-85e1-44b6-af5c-d09f56a49264 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:59.299063 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-922d3986-3d92-4116-9ab4-b82bded67bb3 req-ebddcf4c-fc6f-4b66-af70-c4fd238caacd service nova] Creating event network-changed:3df0b4b3-062a-4219-b9ab-a32600518c32 for instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 on hv-cinder-79578 May 16 15:20:59.300050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d9773ff7-85e1-44b6-af5c-d09f56a49264 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 200 len: 1327 microversion: 2.1 time: 0.109601 May 16 15:20:59.304947 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-922d3986-3d92-4116-9ab4-b82bded67bb3 req-ebddcf4c-fc6f-4b66-af70-c4fd238caacd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032447 May 16 15:20:59.305915 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 360/718] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:20:59.312509 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 359/719] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:59 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:59.617615 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-500c0605-dd05-4b09-867a-ca72a9770ec4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:59.618503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-500c0605-dd05-4b09-867a-ca72a9770ec4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:59.624674 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-500c0605-dd05-4b09-867a-ca72a9770ec4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:59.625177 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-500c0605-dd05-4b09-867a-ca72a9770ec4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:59.625983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-500c0605-dd05-4b09-867a-ca72a9770ec4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:59.626457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-500c0605-dd05-4b09-867a-ca72a9770ec4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:59.648115 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-543d4e2a-5254-418b-9b01-9efc14849f48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:20:59.649029 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-543d4e2a-5254-418b-9b01-9efc14849f48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:20:59.662519 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-543d4e2a-5254-418b-9b01-9efc14849f48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:59.663224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-543d4e2a-5254-418b-9b01-9efc14849f48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:59.664022 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-543d4e2a-5254-418b-9b01-9efc14849f48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:59.664462 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-543d4e2a-5254-418b-9b01-9efc14849f48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:59.825864 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-500c0605-dd05-4b09-867a-ca72a9770ec4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:59.835110 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-500c0605-dd05-4b09-867a-ca72a9770ec4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1319 microversion: 2.1 time: 0.221977 May 16 15:20:59.836060 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 361/720] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:59 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:20:59.922420 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-543d4e2a-5254-418b-9b01-9efc14849f48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:20:59.934628 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-543d4e2a-5254-418b-9b01-9efc14849f48 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1522 microversion: 2.1 time: 0.292026 May 16 15:20:59.937472 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 360/721] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:20:59 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:00.320136 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c3ee937c-d26c-42da-83c8-a87b68c83564 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:00.320838 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c3ee937c-d26c-42da-83c8-a87b68c83564 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:00.327164 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3ee937c-d26c-42da-83c8-a87b68c83564 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:00.327855 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3ee937c-d26c-42da-83c8-a87b68c83564 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:00.328813 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3ee937c-d26c-42da-83c8-a87b68c83564 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:00.329410 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3ee937c-d26c-42da-83c8-a87b68c83564 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:00.344618 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-c3ee937c-d26c-42da-83c8-a87b68c83564 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c3ee937c-d26c-42da-83c8-a87b68c83564 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec HTTP/1.1 May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:21:00.346711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:21:00.348190 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '7914c5a4-73f7-4114-a4ec-d583fecff5ec'} May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:00.349206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:21:00.352868 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:00.355749 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c3ee937c-d26c-42da-83c8-a87b68c83564 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:00.355749 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c3ee937c-d26c-42da-83c8-a87b68c83564 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 404 len: 111 microversion: 2.1 time: 0.031885 May 16 15:21:00.355749 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 362/722] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:00 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:00.363945 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d9fbd4ac-da06-41a4-9185-3f9af61169cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '.version_select at 0x7fc9a72c4dc0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:00.475620 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d9fbd4ac-da06-41a4-9185-3f9af61169cd tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-970697" status: 202 len: 0 microversion: 2.1 time: 0.116734 May 16 15:21:00.477252 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 361/723] 10.222.0.44 () {58 vars in 1208 bytes} [Mon May 16 15:21:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-970697 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:21:00.646514 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-992d8351-f41b-459d-a6de-389ec10c2da7 req-b23ae029-80df-4cf0-b685-d34b0c50eeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cc0b00-99f9-4486-b349-f60a0d2db023", "name": "network-vif-deleted", "tag": "d3200ba0-e507-4313-a271-660316264ca6"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:00.656651 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-992d8351-f41b-459d-a6de-389ec10c2da7 req-b23ae029-80df-4cf0-b685-d34b0c50eeb5 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:00.657338 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-992d8351-f41b-459d-a6de-389ec10c2da7 req-b23ae029-80df-4cf0-b685-d34b0c50eeb5 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:00.669466 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-992d8351-f41b-459d-a6de-389ec10c2da7 req-b23ae029-80df-4cf0-b685-d34b0c50eeb5 service nova] Creating event network-vif-deleted:d3200ba0-e507-4313-a271-660316264ca6 for instance b8cc0b00-99f9-4486-b349-f60a0d2db023 on hv-cinder-79578 May 16 15:21:00.674498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-992d8351-f41b-459d-a6de-389ec10c2da7 req-b23ae029-80df-4cf0-b685-d34b0c50eeb5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102601 May 16 15:21:00.675302 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 363/724] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:00.853172 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c5e7a317-442f-4171-ae41-abf2c674e98e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:00.854517 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c5e7a317-442f-4171-ae41-abf2c674e98e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:00.862460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e7a317-442f-4171-ae41-abf2c674e98e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:00.862460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e7a317-442f-4171-ae41-abf2c674e98e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:00.863152 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e7a317-442f-4171-ae41-abf2c674e98e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:00.863685 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e7a317-442f-4171-ae41-abf2c674e98e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:00.958792 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ced7fd3a-ea31-474c-9016-fbe2da7a932b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:00.961835 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ced7fd3a-ea31-474c-9016-fbe2da7a932b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:00.970445 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ced7fd3a-ea31-474c-9016-fbe2da7a932b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:00.970445 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ced7fd3a-ea31-474c-9016-fbe2da7a932b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:00.970445 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ced7fd3a-ea31-474c-9016-fbe2da7a932b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:00.970838 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ced7fd3a-ea31-474c-9016-fbe2da7a932b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:01.029327 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ced7fd3a-ea31-474c-9016-fbe2da7a932b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:01.030042 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ced7fd3a-ea31-474c-9016-fbe2da7a932b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:01.030676 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-ced7fd3a-ea31-474c-9016-fbe2da7a932b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lazy-loading 'fault' on Instance uuid b8cc0b00-99f9-4486-b349-f60a0d2db023 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:21:01.119691 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c5e7a317-442f-4171-ae41-abf2c674e98e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:01.127868 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c5e7a317-442f-4171-ae41-abf2c674e98e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1319 microversion: 2.1 time: 0.279343 May 16 15:21:01.132586 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 362/725] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:00 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:01.326284 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-786496a3-c474-4faa-b720-75838db98dd6 req-74564144-cdc1-44e9-98a0-93f2e8af3df9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06593e10-12ee-4a95-b2bb-2387e0e18934", "tag": "7b95ef5d-6e82-4fc6-b503-4d9ee45d1f26"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:01.335483 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-786496a3-c474-4faa-b720-75838db98dd6 req-74564144-cdc1-44e9-98a0-93f2e8af3df9 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:01.335931 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-786496a3-c474-4faa-b720-75838db98dd6 req-74564144-cdc1-44e9-98a0-93f2e8af3df9 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:01.346522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-786496a3-c474-4faa-b720-75838db98dd6 req-74564144-cdc1-44e9-98a0-93f2e8af3df9 service nova] Creating event network-changed:7b95ef5d-6e82-4fc6-b503-4d9ee45d1f26 for instance 06593e10-12ee-4a95-b2bb-2387e0e18934 on hv-cinder-79578 May 16 15:21:01.351526 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ced7fd3a-ea31-474c-9016-fbe2da7a932b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14795cb97ac44b2a7fc1e2f79b12253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316917d7a31645bfaac651f81154c18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:01.355503 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-786496a3-c474-4faa-b720-75838db98dd6 req-74564144-cdc1-44e9-98a0-93f2e8af3df9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029872 May 16 15:21:01.355503 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 363/726] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:01.360123 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ced7fd3a-ea31-474c-9016-fbe2da7a932b tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 200 len: 1311 microversion: 2.1 time: 0.410152 May 16 15:21:01.360696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 364/727] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:00 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 1311 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:01.712781 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8f959148-8cd8-476d-aba1-5d07c765de67 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: .version_select at 0x7fc9a731f3a0>, body: {"keypair": {"name": "tempest-keypair-1306909209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlNnntQs7P6Pr5CwhACuhG8qNf1tHZ/L7+MS+02JNOyoFB4/p3nAUjI6jop/VXEINGK5Eemub9J1KZ4GOW/y+z/ROq+E/wk1JZAeIltu8Lbs/W8SDljFF61Iimw1JvCBg=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:01.727034 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-8f959148-8cd8-476d-aba1-5d07c765de67 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for project d143bc5a616249a7beefc7b27962026b. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:01.730805 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-8f959148-8cd8-476d-aba1-5d07c765de67 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for user 44ffd5660baa40a7a3d6918cb5d31e56 and project d143bc5a616249a7beefc7b27962026b. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:01.806367 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8f959148-8cd8-476d-aba1-5d07c765de67 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097829 May 16 15:21:01.806949 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 364/728] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 16 15:21:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:02.150358 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-797593ad-4350-4cbe-8dd4-508df0fee3c1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:02.151249 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-797593ad-4350-4cbe-8dd4-508df0fee3c1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:02.157457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-797593ad-4350-4cbe-8dd4-508df0fee3c1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:02.158213 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-797593ad-4350-4cbe-8dd4-508df0fee3c1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:02.159186 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-797593ad-4350-4cbe-8dd4-508df0fee3c1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:02.159791 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-797593ad-4350-4cbe-8dd4-508df0fee3c1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:02.295118 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-797593ad-4350-4cbe-8dd4-508df0fee3c1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:02.304109 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-797593ad-4350-4cbe-8dd4-508df0fee3c1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1319 microversion: 2.1 time: 0.158261 May 16 15:21:02.304912 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 365/729] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:02 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:02.377833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a72a9aad-e594-445c-8d7d-052e64b3bc42 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:02.378635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a72a9aad-e594-445c-8d7d-052e64b3bc42 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] [instance: b8cc0b00-99f9-4486-b349-f60a0d2db023] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:02.385716 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a72a9aad-e594-445c-8d7d-052e64b3bc42 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:02.386193 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a72a9aad-e594-445c-8d7d-052e64b3bc42 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:02.386980 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a72a9aad-e594-445c-8d7d-052e64b3bc42 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:02.387409 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a72a9aad-e594-445c-8d7d-052e64b3bc42 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:02.402617 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-a72a9aad-e594-445c-8d7d-052e64b3bc42 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] HTTP exception thrown: Instance b8cc0b00-99f9-4486-b349-f60a0d2db023 could not be found. May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a72a9aad-e594-445c-8d7d-052e64b3bc42 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Request method failure captured: May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 HTTP/1.1 May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqK54J41Q5ZxL_QyU-Q-VZdGq9UCScERyQ6w5yYqjVfeWLE0oqK7Gtv2tI5XRhcO1owfgkx6gaoy5Peo_zqyhv_hAxXy3uv_aE0iP8V5OUb4aJoKYMnErP71VH-vqCJkoqC0-9pCtMo-qvAEAPKOEkdMYHcMu8OjF3oWoy4aipwXlQ May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 316917d7a31645bfaac651f81154c18f May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:21:02.404254 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/316917d7a31645bfaac651f81154c18f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/316917d7a31645bfaac651f81154c18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/316917d7a31645bfaac651f81154c18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_316917d7a31645bfaac651f81154c18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 316917d7a31645bfaac651f81154c18f May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1789909565 May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-ServerRescueNegativeTestJSON-1789909565-project May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: a14795cb97ac44b2a7fc1e2f79b12253 May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1789909565-project May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance b8cc0b00-99f9-4486-b349-f60a0d2db023 could not be found. May 16 15:21:02.405876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'b8cc0b00-99f9-4486-b349-f60a0d2db023'} May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cc0b00-99f9-4486-b349-f60a0d2db023 could not be found. May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:02.406754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cc0b00-99f9-4486-b349-f60a0d2db023 could not be found. May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cc0b00-99f9-4486-b349-f60a0d2db023 could not be found. May 16 15:21:02.408236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:21:02.409769 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a72a9aad-e594-445c-8d7d-052e64b3bc42 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] Returning 404 to user: Instance b8cc0b00-99f9-4486-b349-f60a0d2db023 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:02.409769 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a72a9aad-e594-445c-8d7d-052e64b3bc42 tempest-ServerRescueNegativeTestJSON-1789909565 tempest-ServerRescueNegativeTestJSON-1789909565-project] 10.222.0.44 "GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023" status: 404 len: 111 microversion: 2.1 time: 0.032167 May 16 15:21:02.409769 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 365/730] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:02 2022] GET /compute/v2.1/servers/b8cc0b00-99f9-4486-b349-f60a0d2db023 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:03.321356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3f738783-a2ed-4a6b-b61f-a8698c36f4bb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:03.324742 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3f738783-a2ed-4a6b-b61f-a8698c36f4bb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:03.332801 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3f738783-a2ed-4a6b-b61f-a8698c36f4bb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:03.333159 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3f738783-a2ed-4a6b-b61f-a8698c36f4bb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:03.334721 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3f738783-a2ed-4a6b-b61f-a8698c36f4bb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:03.335157 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3f738783-a2ed-4a6b-b61f-a8698c36f4bb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:03.525953 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3f738783-a2ed-4a6b-b61f-a8698c36f4bb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:03.533206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3f738783-a2ed-4a6b-b61f-a8698c36f4bb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1319 microversion: 2.1 time: 0.215805 May 16 15:21:03.533776 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 366/731] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:03 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:04.084134 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1340586520", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "982c6e92-7848-46dd-811d-5ec569a6da67"}], "security_groups": [{"name": "tempest-securitygroup--2028199401"}], "key_name": "tempest-keypair-1306909209", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:04.227133 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] validate_networks() for [('982c6e92-7848-46dd-811d-5ec569a6da67', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:21:04.550474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-aa8fd3f2-accb-4c4d-9d20-0277d9b2f39f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:04.551777 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-aa8fd3f2-accb-4c4d-9d20-0277d9b2f39f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:04.558740 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa8fd3f2-accb-4c4d-9d20-0277d9b2f39f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:04.559456 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa8fd3f2-accb-4c4d-9d20-0277d9b2f39f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:04.560499 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa8fd3f2-accb-4c4d-9d20-0277d9b2f39f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:04.561171 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa8fd3f2-accb-4c4d-9d20-0277d9b2f39f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:04.741821 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:21:04.742550 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:21:04.743790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:21:04.744206 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:21:04.744612 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:21:04.754313 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:04.754761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:04.755552 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:04.755983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:04.772514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for project d143bc5a616249a7beefc7b27962026b. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:04.777029 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Getting quotas for user 44ffd5660baa40a7a3d6918cb5d31e56 and project d143bc5a616249a7beefc7b27962026b. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:04.789616 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:21:04.792748 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:21:04.820498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-aa8fd3f2-accb-4c4d-9d20-0277d9b2f39f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:04.829798 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-aa8fd3f2-accb-4c4d-9d20-0277d9b2f39f tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1319 microversion: 2.1 time: 0.282984 May 16 15:21:04.830637 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 367/732] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:04 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:04.893728 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f02c67a4-68ce-42c7-9254-a944411a8ae6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.815937 May 16 15:21:04.901528 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 366/733] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:21:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:21:04.905655 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-af5d879c-1ddc-43b9-81d9-5b7bf5480a8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:04.906507 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-af5d879c-1ddc-43b9-81d9-5b7bf5480a8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:05.011014 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-af5d879c-1ddc-43b9-81d9-5b7bf5480a8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:05.022424 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-af5d879c-1ddc-43b9-81d9-5b7bf5480a8e tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1242 microversion: 2.1 time: 0.121043 May 16 15:21:05.029593 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 368/734] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:04 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:05.851586 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5a83796f-5111-424f-af61-516174226f2d tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:05.852556 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5a83796f-5111-424f-af61-516174226f2d tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:05.859485 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a83796f-5111-424f-af61-516174226f2d tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:05.859942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a83796f-5111-424f-af61-516174226f2d tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:05.860688 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a83796f-5111-424f-af61-516174226f2d tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:05.861118 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a83796f-5111-424f-af61-516174226f2d tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:05.994287 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5a83796f-5111-424f-af61-516174226f2d tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:06.004066 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5a83796f-5111-424f-af61-516174226f2d tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1319 microversion: 2.1 time: 0.154906 May 16 15:21:06.014289 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 367/735] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:05 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:06.040428 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-56eca86f-b29d-41da-9852-4510a1fcc696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:06.050030 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-56eca86f-b29d-41da-9852-4510a1fcc696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:06.066234 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56eca86f-b29d-41da-9852-4510a1fcc696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:06.066682 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56eca86f-b29d-41da-9852-4510a1fcc696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:06.075638 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56eca86f-b29d-41da-9852-4510a1fcc696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:06.076312 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56eca86f-b29d-41da-9852-4510a1fcc696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:06.193527 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-56eca86f-b29d-41da-9852-4510a1fcc696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:06.202211 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-56eca86f-b29d-41da-9852-4510a1fcc696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1246 microversion: 2.1 time: 0.165763 May 16 15:21:06.212193 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 369/736] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:06 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1246 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:06.508574 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-34ccb346-5260-42d8-96e9-001b668e5290 req-827e24a5-e2fa-434f-bcab-e8c439d9d471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06593e10-12ee-4a95-b2bb-2387e0e18934", "name": "network-vif-plugged", "status": "completed", "tag": "7b95ef5d-6e82-4fc6-b503-4d9ee45d1f26"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:06.516540 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-34ccb346-5260-42d8-96e9-001b668e5290 req-827e24a5-e2fa-434f-bcab-e8c439d9d471 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:06.516986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-34ccb346-5260-42d8-96e9-001b668e5290 req-827e24a5-e2fa-434f-bcab-e8c439d9d471 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:06.528880 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-34ccb346-5260-42d8-96e9-001b668e5290 req-827e24a5-e2fa-434f-bcab-e8c439d9d471 service nova] Creating event network-vif-plugged:7b95ef5d-6e82-4fc6-b503-4d9ee45d1f26 for instance 06593e10-12ee-4a95-b2bb-2387e0e18934 on hv-cinder-79578 May 16 15:21:06.539917 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-34ccb346-5260-42d8-96e9-001b668e5290 req-827e24a5-e2fa-434f-bcab-e8c439d9d471 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035998 May 16 15:21:06.540531 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 368/737] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:07.019261 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8f821bbd-6767-4338-99d1-500535dfe17e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:07.019768 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8f821bbd-6767-4338-99d1-500535dfe17e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:07.026147 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f821bbd-6767-4338-99d1-500535dfe17e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:07.026599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f821bbd-6767-4338-99d1-500535dfe17e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:07.027913 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f821bbd-6767-4338-99d1-500535dfe17e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:07.039034 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f821bbd-6767-4338-99d1-500535dfe17e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:07.221028 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-09d91d8d-da93-4aac-9d61-320587c4ccd2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:07.223607 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-09d91d8d-da93-4aac-9d61-320587c4ccd2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:07.232574 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09d91d8d-da93-4aac-9d61-320587c4ccd2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:07.234012 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09d91d8d-da93-4aac-9d61-320587c4ccd2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:07.235051 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09d91d8d-da93-4aac-9d61-320587c4ccd2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:07.235883 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09d91d8d-da93-4aac-9d61-320587c4ccd2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:07.239979 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8f821bbd-6767-4338-99d1-500535dfe17e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:07.252417 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8f821bbd-6767-4338-99d1-500535dfe17e tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1319 microversion: 2.1 time: 0.236994 May 16 15:21:07.253005 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 370/738] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:07 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:07.322135 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-09d91d8d-da93-4aac-9d61-320587c4ccd2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:07.330354 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-09d91d8d-da93-4aac-9d61-320587c4ccd2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1312 microversion: 2.1 time: 0.113867 May 16 15:21:07.330928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 369/739] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:07 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:08.274774 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f5cb5455-ecf7-4bac-9c57-a50e9d0a8dfb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:08.276167 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f5cb5455-ecf7-4bac-9c57-a50e9d0a8dfb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:08.283371 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5cb5455-ecf7-4bac-9c57-a50e9d0a8dfb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:08.284132 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5cb5455-ecf7-4bac-9c57-a50e9d0a8dfb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:08.285126 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5cb5455-ecf7-4bac-9c57-a50e9d0a8dfb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:08.285746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5cb5455-ecf7-4bac-9c57-a50e9d0a8dfb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:08.347311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dd7fc1fa-e8d4-487b-8e29-1cfdd1770782 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:08.348651 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dd7fc1fa-e8d4-487b-8e29-1cfdd1770782 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:08.355906 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd7fc1fa-e8d4-487b-8e29-1cfdd1770782 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:08.356677 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd7fc1fa-e8d4-487b-8e29-1cfdd1770782 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:08.357455 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd7fc1fa-e8d4-487b-8e29-1cfdd1770782 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:08.358180 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd7fc1fa-e8d4-487b-8e29-1cfdd1770782 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:08.475096 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f5cb5455-ecf7-4bac-9c57-a50e9d0a8dfb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:08.484430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f5cb5455-ecf7-4bac-9c57-a50e9d0a8dfb tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1319 microversion: 2.1 time: 0.218492 May 16 15:21:08.484908 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 371/740] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:08 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:08.540879 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dd7fc1fa-e8d4-487b-8e29-1cfdd1770782 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:08.549070 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dd7fc1fa-e8d4-487b-8e29-1cfdd1770782 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1368 microversion: 2.1 time: 0.205534 May 16 15:21:08.549638 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 370/741] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:08 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:09.500736 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-aff974b4-1c0b-46b5-94fd-8f57a6de9166 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:09.501354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-aff974b4-1c0b-46b5-94fd-8f57a6de9166 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:09.507956 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aff974b4-1c0b-46b5-94fd-8f57a6de9166 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:09.508407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aff974b4-1c0b-46b5-94fd-8f57a6de9166 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:09.510649 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aff974b4-1c0b-46b5-94fd-8f57a6de9166 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:09.510649 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aff974b4-1c0b-46b5-94fd-8f57a6de9166 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:09.566830 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5a077a98-538e-414d-9066-8868572bb06f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:09.568569 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5a077a98-538e-414d-9066-8868572bb06f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:09.576983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a077a98-538e-414d-9066-8868572bb06f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:09.577687 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a077a98-538e-414d-9066-8868572bb06f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:09.578678 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a077a98-538e-414d-9066-8868572bb06f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:09.579276 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a077a98-538e-414d-9066-8868572bb06f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:09.737856 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-aff974b4-1c0b-46b5-94fd-8f57a6de9166 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:09.746444 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-aff974b4-1c0b-46b5-94fd-8f57a6de9166 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1508 microversion: 2.1 time: 0.249542 May 16 15:21:09.747404 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 372/742] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:09 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:09.752274 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-0eadf0eb-64fc-4c10-ba5d-5d695b6309c0 req-e8895e46-f994-4d8d-a35b-ead2c0f30824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779684af-ad5e-4d00-9ea9-67d0c37dbdce", "tag": "74efad31-6e64-40bc-9867-6c6e7c294314"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:09.760813 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-0eadf0eb-64fc-4c10-ba5d-5d695b6309c0 req-e8895e46-f994-4d8d-a35b-ead2c0f30824 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:09.761559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-0eadf0eb-64fc-4c10-ba5d-5d695b6309c0 req-e8895e46-f994-4d8d-a35b-ead2c0f30824 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:09.778666 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-0eadf0eb-64fc-4c10-ba5d-5d695b6309c0 req-e8895e46-f994-4d8d-a35b-ead2c0f30824 service nova] Creating event network-changed:74efad31-6e64-40bc-9867-6c6e7c294314 for instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce on hv-cinder-79578 May 16 15:21:09.784141 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-0eadf0eb-64fc-4c10-ba5d-5d695b6309c0 req-e8895e46-f994-4d8d-a35b-ead2c0f30824 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035181 May 16 15:21:09.785297 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 373/743] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:09.793390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c6de4c64-5596-45c4-aef3-763ce70805b9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9856e5a1-1b6f-4716-800d-0ddc8e8d8aea", "device": "/dev/sdb"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:09.795703 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c6de4c64-5596-45c4-aef3-763ce70805b9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:09.797411 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5a077a98-538e-414d-9066-8868572bb06f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:09.801852 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c6de4c64-5596-45c4-aef3-763ce70805b9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:09.802325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c6de4c64-5596-45c4-aef3-763ce70805b9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:09.808633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c6de4c64-5596-45c4-aef3-763ce70805b9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:09.808633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c6de4c64-5596-45c4-aef3-763ce70805b9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:09.808939 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5a077a98-538e-414d-9066-8868572bb06f tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1368 microversion: 2.1 time: 0.242540 May 16 15:21:09.808939 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 371/744] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:09 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:10.615682 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c6de4c64-5596-45c4-aef3-763ce70805b9 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "POST /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.828399 May 16 15:21:10.616508 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 374/745] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:21:09 2022] POST /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:10.822143 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fe302f9a-9c8a-4953-8f1d-fb92696f2e08 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:10.822758 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fe302f9a-9c8a-4953-8f1d-fb92696f2e08 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:10.829640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe302f9a-9c8a-4953-8f1d-fb92696f2e08 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:10.830125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe302f9a-9c8a-4953-8f1d-fb92696f2e08 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:10.830903 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe302f9a-9c8a-4953-8f1d-fb92696f2e08 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:10.839856 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe302f9a-9c8a-4953-8f1d-fb92696f2e08 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:11.319321 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fe302f9a-9c8a-4953-8f1d-fb92696f2e08 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:11.328378 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fe302f9a-9c8a-4953-8f1d-fb92696f2e08 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1368 microversion: 2.1 time: 0.510123 May 16 15:21:11.328975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 372/746] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:10 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1368 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:12.345885 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0dc5b844-b415-4742-8923-4b6b94a8983d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:12.347043 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0dc5b844-b415-4742-8923-4b6b94a8983d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:12.353124 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0dc5b844-b415-4742-8923-4b6b94a8983d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:12.353640 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0dc5b844-b415-4742-8923-4b6b94a8983d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:12.354791 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0dc5b844-b415-4742-8923-4b6b94a8983d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:12.354961 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0dc5b844-b415-4742-8923-4b6b94a8983d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:12.509561 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0dc5b844-b415-4742-8923-4b6b94a8983d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:12.515275 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0dc5b844-b415-4742-8923-4b6b94a8983d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1368 microversion: 2.1 time: 0.174132 May 16 15:21:12.517068 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 375/747] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:12 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:12.686368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-de09e32b-0de6-41d0-a602-85a6bcf15c34 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:12.686951 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-de09e32b-0de6-41d0-a602-85a6bcf15c34 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:12.693192 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de09e32b-0de6-41d0-a602-85a6bcf15c34 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:12.693642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de09e32b-0de6-41d0-a602-85a6bcf15c34 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:12.694681 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de09e32b-0de6-41d0-a602-85a6bcf15c34 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:12.695107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de09e32b-0de6-41d0-a602-85a6bcf15c34 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:12.723450 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-de09e32b-0de6-41d0-a602-85a6bcf15c34 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:21:13.011458 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-de09e32b-0de6-41d0-a602-85a6bcf15c34 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 204 len: 0 microversion: 2.1 time: 0.329150 May 16 15:21:13.012362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 373/748] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:21:12 2022] DELETE /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:21:13.022938 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2cbcee9d-5d93-496e-9630-31d71abcaec0 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:13.025320 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2cbcee9d-5d93-496e-9630-31d71abcaec0 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:13.037582 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cbcee9d-5d93-496e-9630-31d71abcaec0 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:13.038656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cbcee9d-5d93-496e-9630-31d71abcaec0 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:13.040559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cbcee9d-5d93-496e-9630-31d71abcaec0 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:13.041223 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2cbcee9d-5d93-496e-9630-31d71abcaec0 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:13.196304 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2cbcee9d-5d93-496e-9630-31d71abcaec0 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:13.204425 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2cbcee9d-5d93-496e-9630-31d71abcaec0 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1578 microversion: 2.1 time: 0.186674 May 16 15:21:13.205086 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 376/749] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:13 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:13.535225 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6d65ecd9-ffa2-4c9d-b7ef-945975008e02 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:13.535225 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6d65ecd9-ffa2-4c9d-b7ef-945975008e02 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:13.540510 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d65ecd9-ffa2-4c9d-b7ef-945975008e02 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:13.541178 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d65ecd9-ffa2-4c9d-b7ef-945975008e02 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:13.542159 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d65ecd9-ffa2-4c9d-b7ef-945975008e02 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:13.542752 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d65ecd9-ffa2-4c9d-b7ef-945975008e02 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:13.758871 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6d65ecd9-ffa2-4c9d-b7ef-945975008e02 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:13.769526 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6d65ecd9-ffa2-4c9d-b7ef-945975008e02 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1368 microversion: 2.1 time: 0.240278 May 16 15:21:13.770520 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 374/750] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:13 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:14.224810 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b15a4460-a7eb-4d32-ae98-921842179810 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:14.226435 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b15a4460-a7eb-4d32-ae98-921842179810 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:14.243516 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b15a4460-a7eb-4d32-ae98-921842179810 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:14.243516 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b15a4460-a7eb-4d32-ae98-921842179810 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:14.246371 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b15a4460-a7eb-4d32-ae98-921842179810 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:14.247061 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b15a4460-a7eb-4d32-ae98-921842179810 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:14.412873 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-c33fe817-61c9-4d09-ad32-655dde137ea5 req-4cc50868-2faa-4b6b-a5e9-e3ddbd38c5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779684af-ad5e-4d00-9ea9-67d0c37dbdce", "name": "network-vif-plugged", "status": "completed", "tag": "74efad31-6e64-40bc-9867-6c6e7c294314"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:14.422497 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c33fe817-61c9-4d09-ad32-655dde137ea5 req-4cc50868-2faa-4b6b-a5e9-e3ddbd38c5a4 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:14.423425 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c33fe817-61c9-4d09-ad32-655dde137ea5 req-4cc50868-2faa-4b6b-a5e9-e3ddbd38c5a4 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:14.445128 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-c33fe817-61c9-4d09-ad32-655dde137ea5 req-4cc50868-2faa-4b6b-a5e9-e3ddbd38c5a4 service nova] Creating event network-vif-plugged:74efad31-6e64-40bc-9867-6c6e7c294314 for instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce on hv-cinder-79578 May 16 15:21:14.452822 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-c33fe817-61c9-4d09-ad32-655dde137ea5 req-4cc50868-2faa-4b6b-a5e9-e3ddbd38c5a4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047052 May 16 15:21:14.454249 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 375/751] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:14.460262 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b15a4460-a7eb-4d32-ae98-921842179810 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:14.468646 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b15a4460-a7eb-4d32-ae98-921842179810 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1578 microversion: 2.1 time: 0.248898 May 16 15:21:14.470097 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 377/752] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:14 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1578 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:14.756489 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ecaac966-030b-40d9-9161-f998cb89abde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Action: 'create', calling method: .version_select at 0x7fc9a722caf0>, body: {"keypair": {"name": "tempest-keypair-1765314608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcXgDfwCjYPTXwlJT6HGiAaiT53SRr8r3JwR/MqRzxNzsrEDl95QE7cyvr9FwvDYimwjFhq8upCtwFgpX7XB1UyJ1a/B3lUQ8Pvh0xhO6Sf2gvXkwHZ2bzpXQfT8L0UtA=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:14.771298 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-ecaac966-030b-40d9-9161-f998cb89abde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Getting quotas for project 440329d501de48d19ba51dceaa845197. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:14.775062 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-ecaac966-030b-40d9-9161-f998cb89abde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Getting quotas for user c7788bd93c7649368e3fc926a969c7ed and project 440329d501de48d19ba51dceaa845197. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:14.786329 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a5571f9e-6a59-40ee-840e-edc2263e6696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:14.787014 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a5571f9e-6a59-40ee-840e-edc2263e6696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:14.792913 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5571f9e-6a59-40ee-840e-edc2263e6696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:14.793358 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5571f9e-6a59-40ee-840e-edc2263e6696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:14.794135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5571f9e-6a59-40ee-840e-edc2263e6696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:14.794566 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5571f9e-6a59-40ee-840e-edc2263e6696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:14.884779 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ecaac966-030b-40d9-9161-f998cb89abde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.246778 May 16 15:21:14.885869 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 376/753] 10.222.0.44 () {62 vars in 1199 bytes} [Mon May 16 15:21:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 15:21:14.939668 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a5571f9e-6a59-40ee-840e-edc2263e6696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:14.948894 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a5571f9e-6a59-40ee-840e-edc2263e6696 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1368 microversion: 2.1 time: 0.165779 May 16 15:21:14.949043 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 378/754] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:14 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:15.486994 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3800ba86-baa7-472a-b656-6012bfb62289 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:15.489469 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3800ba86-baa7-472a-b656-6012bfb62289 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:15.497295 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3800ba86-baa7-472a-b656-6012bfb62289 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:15.497979 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3800ba86-baa7-472a-b656-6012bfb62289 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:15.499131 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3800ba86-baa7-472a-b656-6012bfb62289 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:15.500075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3800ba86-baa7-472a-b656-6012bfb62289 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:15.735395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3800ba86-baa7-472a-b656-6012bfb62289 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:15.747540 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3800ba86-baa7-472a-b656-6012bfb62289 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1578 microversion: 2.1 time: 0.265088 May 16 15:21:15.750352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 377/755] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:15 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1578 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:15.969561 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-066ccc56-9424-44eb-b5d8-8fedd6e91da8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:15.971887 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-066ccc56-9424-44eb-b5d8-8fedd6e91da8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:15.982792 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-066ccc56-9424-44eb-b5d8-8fedd6e91da8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:15.984223 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-066ccc56-9424-44eb-b5d8-8fedd6e91da8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:15.985269 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-066ccc56-9424-44eb-b5d8-8fedd6e91da8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:15.986095 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-066ccc56-9424-44eb-b5d8-8fedd6e91da8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:16.208535 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-066ccc56-9424-44eb-b5d8-8fedd6e91da8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:16.218819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-066ccc56-9424-44eb-b5d8-8fedd6e91da8 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1368 microversion: 2.1 time: 0.255978 May 16 15:21:16.221492 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 379/756] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:15 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:16.234262 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-94c09485-e1ae-4904-9bea-f80c760485a6 req-d05552e2-da6d-4539-92bd-6f3e302c62d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fdfaa8-6784-48ce-9d0e-f67d7560a677", "name": "network-vif-deleted", "tag": "db5b37d8-c741-4890-90db-e06eab6bdb47"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:16.243186 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-94c09485-e1ae-4904-9bea-f80c760485a6 req-d05552e2-da6d-4539-92bd-6f3e302c62d2 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:16.244034 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-94c09485-e1ae-4904-9bea-f80c760485a6 req-d05552e2-da6d-4539-92bd-6f3e302c62d2 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:16.258508 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-94c09485-e1ae-4904-9bea-f80c760485a6 req-d05552e2-da6d-4539-92bd-6f3e302c62d2 service nova] Creating event network-vif-deleted:db5b37d8-c741-4890-90db-e06eab6bdb47 for instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 on hv-cinder-79578 May 16 15:21:16.263957 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-94c09485-e1ae-4904-9bea-f80c760485a6 req-d05552e2-da6d-4539-92bd-6f3e302c62d2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033980 May 16 15:21:16.265347 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 378/757] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:16.769026 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d9cd2d5e-ea60-443b-9821-ee54be88b64d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:16.769809 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d9cd2d5e-ea60-443b-9821-ee54be88b64d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:16.776280 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9cd2d5e-ea60-443b-9821-ee54be88b64d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:16.797750 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9cd2d5e-ea60-443b-9821-ee54be88b64d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:16.799873 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9cd2d5e-ea60-443b-9821-ee54be88b64d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:16.802805 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9cd2d5e-ea60-443b-9821-ee54be88b64d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:16.972739 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d9cd2d5e-ea60-443b-9821-ee54be88b64d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:16.993453 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d9cd2d5e-ea60-443b-9821-ee54be88b64d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1226 microversion: 2.1 time: 0.228578 May 16 15:21:17.003275 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 380/758] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:16 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1226 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:17.236868 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-04d63b68-d9ef-43d7-b8ee-06834b9129d6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:17.238314 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-04d63b68-d9ef-43d7-b8ee-06834b9129d6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:17.245529 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04d63b68-d9ef-43d7-b8ee-06834b9129d6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:17.246262 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04d63b68-d9ef-43d7-b8ee-06834b9129d6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:17.247261 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04d63b68-d9ef-43d7-b8ee-06834b9129d6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:17.247895 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04d63b68-d9ef-43d7-b8ee-06834b9129d6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:17.438379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-04d63b68-d9ef-43d7-b8ee-06834b9129d6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:17.446049 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-04d63b68-d9ef-43d7-b8ee-06834b9129d6 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1558 microversion: 2.1 time: 0.214114 May 16 15:21:17.446656 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 379/759] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:17 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:17.482915 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4ed0912a-434e-4901-a254-93ea8b8b1fc4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:17.486709 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4ed0912a-434e-4901-a254-93ea8b8b1fc4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:17.493832 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ed0912a-434e-4901-a254-93ea8b8b1fc4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:17.497387 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ed0912a-434e-4901-a254-93ea8b8b1fc4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:17.498416 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ed0912a-434e-4901-a254-93ea8b8b1fc4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:17.499000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ed0912a-434e-4901-a254-93ea8b8b1fc4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:17.591912 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4ed0912a-434e-4901-a254-93ea8b8b1fc4 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132089 May 16 15:21:17.592602 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 381/760] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 16 15:21:17 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:17.860853 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-466023931", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "998469a5-51c9-48fa-9255-eb909b168691"}], "security_groups": [{"name": "tempest-securitygroup--673450595"}], "key_name": "tempest-keypair-1765314608", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:18.011023 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-da75e577-f8d7-43c8-abd9-04a13f9d7bee tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:18.011576 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-da75e577-f8d7-43c8-abd9-04a13f9d7bee tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:18.018626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da75e577-f8d7-43c8-abd9-04a13f9d7bee tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:18.019112 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da75e577-f8d7-43c8-abd9-04a13f9d7bee tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:18.019899 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da75e577-f8d7-43c8-abd9-04a13f9d7bee tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:18.020335 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da75e577-f8d7-43c8-abd9-04a13f9d7bee tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:18.055940 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da75e577-f8d7-43c8-abd9-04a13f9d7bee tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:18.057884 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da75e577-f8d7-43c8-abd9-04a13f9d7bee tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:18.058383 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-da75e577-f8d7-43c8-abd9-04a13f9d7bee tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lazy-loading 'fault' on Instance uuid e4fdfaa8-6784-48ce-9d0e-f67d7560a677 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:21:18.120778 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-da75e577-f8d7-43c8-abd9-04a13f9d7bee tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:18.143961 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-da75e577-f8d7-43c8-abd9-04a13f9d7bee tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 200 len: 1231 microversion: 2.1 time: 0.136283 May 16 15:21:18.144154 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 382/761] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:18 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 1231 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:18.348588 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] validate_networks() for [('998469a5-51c9-48fa-9255-eb909b168691', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:21:19.018812 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:21:19.019241 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:21:19.019711 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:21:19.020112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:21:19.020575 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:21:19.029489 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.030045 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.031037 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.032119 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.048782 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Getting quotas for project 440329d501de48d19ba51dceaa845197. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:19.053315 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Getting quotas for user c7788bd93c7649368e3fc926a969c7ed and project 440329d501de48d19ba51dceaa845197. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:19.064903 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:21:19.067267 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:21:19.159786 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-92df6a41-a85c-4c00-aff1-99d1b22fc2fe tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:19.160389 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-92df6a41-a85c-4c00-aff1-99d1b22fc2fe tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:19.167181 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92df6a41-a85c-4c00-aff1-99d1b22fc2fe tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.167818 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92df6a41-a85c-4c00-aff1-99d1b22fc2fe tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.168583 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92df6a41-a85c-4c00-aff1-99d1b22fc2fe tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.169940 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92df6a41-a85c-4c00-aff1-99d1b22fc2fe tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.171434 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bb722f2d-f9c4-4a37-84b6-01388dd389ef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.315894 May 16 15:21:19.172472 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 380/762] 10.222.0.44 () {62 vars in 1187 bytes} [Mon May 16 15:21:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 15:21:19.181862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d1e70a1b-c22c-49c9-9451-a535eaf8bb07 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:19.182730 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d1e70a1b-c22c-49c9-9451-a535eaf8bb07 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:19.187487 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-92df6a41-a85c-4c00-aff1-99d1b22fc2fe tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] HTTP exception thrown: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-92df6a41-a85c-4c00-aff1-99d1b22fc2fe tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Request method failure captured: May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 HTTP/1.1 May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmsyvQOKylehpvjj-vLVYoLjPM9s4cjib2oSrqi1AJiNJKPxoHtYPJfE6KBtTh7lDema3Eq6vD6drGrDNPh5Wcav-YK7iuS6h2S2HPEEtO2JEjBsrqSyspScKAbnSaw6dExGAYgDQMDifGFc78o8fj6sEhWzpApOU4Ww7ZxqHIwTkho May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: b025f7f102ee46fa92e9bb7445e59daa May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-TestVolumeBootPattern-717549113 May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:21:19.191162 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-TestVolumeBootPattern-717549113 May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: b025f7f102ee46fa92e9bb7445e59daa May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-TestVolumeBootPattern-717549113 May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-TestVolumeBootPattern-717549113-project May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: b34f24054c204d7cb69ca41099913ca5 May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-TestVolumeBootPattern-717549113-project May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:21:19.192896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': 'e4fdfaa8-6784-48ce-9d0e-f67d7560a677'} May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:19.193811 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:21:19.195326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:19.198960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-92df6a41-a85c-4c00-aff1-99d1b22fc2fe tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Returning 404 to user: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:19.200060 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-92df6a41-a85c-4c00-aff1-99d1b22fc2fe tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 404 len: 111 microversion: 2.1 time: 0.044844 May 16 15:21:19.200809 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 383/763] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:19 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:21:19.299745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d1e70a1b-c22c-49c9-9451-a535eaf8bb07 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:19.304046 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1157614894", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1195768707", "security_groups": [{"name": "tempest-secgroup-smoke-649752004"}], "block_device_mapping_v2": [{"uuid": "69cacaa1-520b-44f7-a2b7-895812c09d21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f80dbf35-88c8-44d8-af2b-bea94475a461"}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:19.323689 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d1e70a1b-c22c-49c9-9451-a535eaf8bb07 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:19.330011 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d1e70a1b-c22c-49c9-9451-a535eaf8bb07 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:19.331186 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d1e70a1b-c22c-49c9-9451-a535eaf8bb07 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1281 microversion: 2.20 time: 0.153229 May 16 15:21:19.332491 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 381/764] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:19 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1281 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:21:19.364321 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-65c14c28-612c-477a-b88a-3d050851b5c6 req-42273095-40fc-4f40-84f3-ffdf32de3676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779684af-ad5e-4d00-9ea9-67d0c37dbdce", "tag": "74efad31-6e64-40bc-9867-6c6e7c294314"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:19.373817 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-65c14c28-612c-477a-b88a-3d050851b5c6 req-42273095-40fc-4f40-84f3-ffdf32de3676 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.374293 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-65c14c28-612c-477a-b88a-3d050851b5c6 req-42273095-40fc-4f40-84f3-ffdf32de3676 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.398884 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-65c14c28-612c-477a-b88a-3d050851b5c6 req-42273095-40fc-4f40-84f3-ffdf32de3676 service nova] Creating event network-changed:74efad31-6e64-40bc-9867-6c6e7c294314 for instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce on hv-cinder-79578 May 16 15:21:19.400264 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-65c14c28-612c-477a-b88a-3d050851b5c6 req-42273095-40fc-4f40-84f3-ffdf32de3676 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039443 May 16 15:21:19.401085 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 382/765] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:19.437126 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] validate_networks() for [('f80dbf35-88c8-44d8-af2b-bea94475a461', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:21:19.908709 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:21:19.909135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:21:19.909771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:21:19.910457 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:21:19.910875 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:21:19.924110 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.925045 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.926124 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.926865 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.948980 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Getting quotas for project b025f7f102ee46fa92e9bb7445e59daa. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:19.955054 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Getting quotas for user b34f24054c204d7cb69ca41099913ca5 and project b025f7f102ee46fa92e9bb7445e59daa. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:20.040845 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:21:20.043309 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69cacaa1-520b-44f7-a2b7-895812c09d21',volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:21:20.351552 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ceba3d58-f0ed-46ae-9d1b-a2ea317c6308 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:20.352247 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ceba3d58-f0ed-46ae-9d1b-a2ea317c6308 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:20.428080 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ceba3d58-f0ed-46ae-9d1b-a2ea317c6308 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:20.435987 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ceba3d58-f0ed-46ae-9d1b-a2ea317c6308 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:20.437490 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ceba3d58-f0ed-46ae-9d1b-a2ea317c6308 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:20.438628 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ceba3d58-f0ed-46ae-9d1b-a2ea317c6308 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1281 microversion: 2.20 time: 0.092035 May 16 15:21:20.439183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 383/766] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:20 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:21:20.531691 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6778abed-4c99-4218-9ef4-91bf4f0ffbf8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.231394 May 16 15:21:20.533058 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 384/767] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:21:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:21:20.542818 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-40c6c5cd-5e24-423b-a474-8e34ec6d0f8a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:20.543425 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-40c6c5cd-5e24-423b-a474-8e34ec6d0f8a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:20.610943 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-40c6c5cd-5e24-423b-a474-8e34ec6d0f8a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:20.618312 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-40c6c5cd-5e24-423b-a474-8e34ec6d0f8a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1095 microversion: 2.1 time: 0.079219 May 16 15:21:20.619122 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 384/768] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:20 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:21.456268 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5c971899-0288-46c1-8f83-a15bfc9d016a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:21.456820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5c971899-0288-46c1-8f83-a15bfc9d016a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:21.463888 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c971899-0288-46c1-8f83-a15bfc9d016a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:21.464335 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c971899-0288-46c1-8f83-a15bfc9d016a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:21.465092 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c971899-0288-46c1-8f83-a15bfc9d016a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:21.465522 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5c971899-0288-46c1-8f83-a15bfc9d016a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:21.526262 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5c971899-0288-46c1-8f83-a15bfc9d016a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:21.534542 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5c971899-0288-46c1-8f83-a15bfc9d016a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:21.536047 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5c971899-0288-46c1-8f83-a15bfc9d016a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:21.537137 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5c971899-0288-46c1-8f83-a15bfc9d016a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1285 microversion: 2.20 time: 0.084914 May 16 15:21:21.537699 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 385/769] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:21 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:21.634939 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e88f67fc-ffae-4d2d-b80e-ddae9ea7de13 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:21.635546 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e88f67fc-ffae-4d2d-b80e-ddae9ea7de13 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:21.642011 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e88f67fc-ffae-4d2d-b80e-ddae9ea7de13 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:21.642488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e88f67fc-ffae-4d2d-b80e-ddae9ea7de13 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:21.643257 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e88f67fc-ffae-4d2d-b80e-ddae9ea7de13 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:21.643692 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e88f67fc-ffae-4d2d-b80e-ddae9ea7de13 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:21.702228 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e88f67fc-ffae-4d2d-b80e-ddae9ea7de13 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:21.709463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e88f67fc-ffae-4d2d-b80e-ddae9ea7de13 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1145 microversion: 2.1 time: 0.078281 May 16 15:21:21.709963 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 385/770] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:21 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:22.554771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ed4e28a7-a318-4eb4-b7b2-c579a2e4d33c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:22.555382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ed4e28a7-a318-4eb4-b7b2-c579a2e4d33c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:22.561692 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed4e28a7-a318-4eb4-b7b2-c579a2e4d33c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:22.562171 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed4e28a7-a318-4eb4-b7b2-c579a2e4d33c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:22.562943 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed4e28a7-a318-4eb4-b7b2-c579a2e4d33c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:22.563376 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed4e28a7-a318-4eb4-b7b2-c579a2e4d33c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:22.628675 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ed4e28a7-a318-4eb4-b7b2-c579a2e4d33c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:22.636361 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ed4e28a7-a318-4eb4-b7b2-c579a2e4d33c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:22.637931 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ed4e28a7-a318-4eb4-b7b2-c579a2e4d33c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:22.639052 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ed4e28a7-a318-4eb4-b7b2-c579a2e4d33c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1285 microversion: 2.20 time: 0.088258 May 16 15:21:22.639617 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 386/771] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:22 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:22.726183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2d606db6-978a-4ee0-8d7f-bfbad03a988f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:22.726719 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2d606db6-978a-4ee0-8d7f-bfbad03a988f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:22.732947 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d606db6-978a-4ee0-8d7f-bfbad03a988f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:22.733392 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d606db6-978a-4ee0-8d7f-bfbad03a988f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:22.734179 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d606db6-978a-4ee0-8d7f-bfbad03a988f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:22.734609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d606db6-978a-4ee0-8d7f-bfbad03a988f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:22.795750 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2d606db6-978a-4ee0-8d7f-bfbad03a988f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:22.803769 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2d606db6-978a-4ee0-8d7f-bfbad03a988f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1145 microversion: 2.1 time: 0.081288 May 16 15:21:22.804599 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 386/772] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:22 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:23.656581 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-83c49fb1-8802-486b-903e-3d4377094ca8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:23.657185 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-83c49fb1-8802-486b-903e-3d4377094ca8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:23.664410 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-83c49fb1-8802-486b-903e-3d4377094ca8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:23.664875 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-83c49fb1-8802-486b-903e-3d4377094ca8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:23.665913 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-83c49fb1-8802-486b-903e-3d4377094ca8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:23.666378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-83c49fb1-8802-486b-903e-3d4377094ca8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:23.727160 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-83c49fb1-8802-486b-903e-3d4377094ca8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:23.734225 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-83c49fb1-8802-486b-903e-3d4377094ca8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:23.735728 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-83c49fb1-8802-486b-903e-3d4377094ca8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:23.737078 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-83c49fb1-8802-486b-903e-3d4377094ca8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1333 microversion: 2.20 time: 0.084111 May 16 15:21:23.737621 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 387/773] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:23 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:23.821171 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-46051911-db81-44ea-89d7-a7ec3eb29b0a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:23.821782 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-46051911-db81-44ea-89d7-a7ec3eb29b0a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:23.828050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46051911-db81-44ea-89d7-a7ec3eb29b0a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:23.828500 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46051911-db81-44ea-89d7-a7ec3eb29b0a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:23.829268 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46051911-db81-44ea-89d7-a7ec3eb29b0a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:23.829890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46051911-db81-44ea-89d7-a7ec3eb29b0a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:23.895401 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-46051911-db81-44ea-89d7-a7ec3eb29b0a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:23.902697 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-46051911-db81-44ea-89d7-a7ec3eb29b0a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1193 microversion: 2.1 time: 0.085400 May 16 15:21:23.903266 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 387/774] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:23 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:24.757161 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8a3a4c7f-11d2-4b1b-a6f1-a023cfc8db93 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:24.757745 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8a3a4c7f-11d2-4b1b-a6f1-a023cfc8db93 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:24.764188 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8a3a4c7f-11d2-4b1b-a6f1-a023cfc8db93 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:24.764746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8a3a4c7f-11d2-4b1b-a6f1-a023cfc8db93 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:24.765610 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8a3a4c7f-11d2-4b1b-a6f1-a023cfc8db93 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:24.766157 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8a3a4c7f-11d2-4b1b-a6f1-a023cfc8db93 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:24.828908 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8a3a4c7f-11d2-4b1b-a6f1-a023cfc8db93 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:24.837102 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8a3a4c7f-11d2-4b1b-a6f1-a023cfc8db93 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:24.838629 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8a3a4c7f-11d2-4b1b-a6f1-a023cfc8db93 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:24.840016 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8a3a4c7f-11d2-4b1b-a6f1-a023cfc8db93 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1339 microversion: 2.20 time: 0.086824 May 16 15:21:24.840832 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 388/775] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:24 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:24.919341 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cccd6f2d-db04-461f-b9aa-9064bca9bf6d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:24.919888 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cccd6f2d-db04-461f-b9aa-9064bca9bf6d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:24.926371 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cccd6f2d-db04-461f-b9aa-9064bca9bf6d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:24.926825 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cccd6f2d-db04-461f-b9aa-9064bca9bf6d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:24.933443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cccd6f2d-db04-461f-b9aa-9064bca9bf6d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:24.933443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cccd6f2d-db04-461f-b9aa-9064bca9bf6d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:25.009812 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cccd6f2d-db04-461f-b9aa-9064bca9bf6d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:25.017173 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cccd6f2d-db04-461f-b9aa-9064bca9bf6d tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1211 microversion: 2.1 time: 0.101753 May 16 15:21:25.017746 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 388/776] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:24 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1211 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:25.858543 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3804bfe8-e313-40db-a291-8afc0ba31659 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:25.859117 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3804bfe8-e313-40db-a291-8afc0ba31659 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:25.866253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3804bfe8-e313-40db-a291-8afc0ba31659 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:25.866705 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3804bfe8-e313-40db-a291-8afc0ba31659 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:25.867469 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3804bfe8-e313-40db-a291-8afc0ba31659 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:25.867902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3804bfe8-e313-40db-a291-8afc0ba31659 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:25.993960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3804bfe8-e313-40db-a291-8afc0ba31659 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:26.001972 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3804bfe8-e313-40db-a291-8afc0ba31659 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:26.010279 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3804bfe8-e313-40db-a291-8afc0ba31659 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:26.010279 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3804bfe8-e313-40db-a291-8afc0ba31659 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1406 microversion: 2.20 time: 0.150637 May 16 15:21:26.010279 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 389/777] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:25 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:26.034574 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8e312a27-e5e6-4879-84f4-00b24b270712 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:26.039001 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8e312a27-e5e6-4879-84f4-00b24b270712 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:26.042132 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e312a27-e5e6-4879-84f4-00b24b270712 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:26.042589 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e312a27-e5e6-4879-84f4-00b24b270712 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:26.043360 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e312a27-e5e6-4879-84f4-00b24b270712 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:26.043799 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e312a27-e5e6-4879-84f4-00b24b270712 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:26.173802 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8e312a27-e5e6-4879-84f4-00b24b270712 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:26.181728 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8e312a27-e5e6-4879-84f4-00b24b270712 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1278 microversion: 2.1 time: 0.151075 May 16 15:21:26.182327 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 389/778] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:26 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:27.023790 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-48be06d0-ccfa-4744-96c0-7fd95e690c57 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:27.024311 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-48be06d0-ccfa-4744-96c0-7fd95e690c57 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:27.030789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48be06d0-ccfa-4744-96c0-7fd95e690c57 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.031244 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48be06d0-ccfa-4744-96c0-7fd95e690c57 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.032009 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48be06d0-ccfa-4744-96c0-7fd95e690c57 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.032441 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48be06d0-ccfa-4744-96c0-7fd95e690c57 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.158234 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-48be06d0-ccfa-4744-96c0-7fd95e690c57 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:27.165964 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-48be06d0-ccfa-4744-96c0-7fd95e690c57 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:27.172693 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-48be06d0-ccfa-4744-96c0-7fd95e690c57 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:27.172693 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-48be06d0-ccfa-4744-96c0-7fd95e690c57 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1406 microversion: 2.20 time: 0.149477 May 16 15:21:27.172693 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 390/779] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:27 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:27.198291 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-35ed3f1a-78ca-4377-84ea-2ca48fe745cf tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:27.199064 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-35ed3f1a-78ca-4377-84ea-2ca48fe745cf tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:27.205319 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-35ed3f1a-78ca-4377-84ea-2ca48fe745cf tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.205762 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-35ed3f1a-78ca-4377-84ea-2ca48fe745cf tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.206560 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-35ed3f1a-78ca-4377-84ea-2ca48fe745cf tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.206998 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-35ed3f1a-78ca-4377-84ea-2ca48fe745cf tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.628959 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-35ed3f1a-78ca-4377-84ea-2ca48fe745cf tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:27.636451 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-35ed3f1a-78ca-4377-84ea-2ca48fe745cf tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1278 microversion: 2.1 time: 0.441951 May 16 15:21:27.637029 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 390/780] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:27 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1278 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:28.186633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c1c16509-fd80-4c5c-8633-77652cfdfe42 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:28.187249 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c1c16509-fd80-4c5c-8633-77652cfdfe42 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:28.193792 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1c16509-fd80-4c5c-8633-77652cfdfe42 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:28.194296 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1c16509-fd80-4c5c-8633-77652cfdfe42 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:28.195311 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1c16509-fd80-4c5c-8633-77652cfdfe42 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:28.195751 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1c16509-fd80-4c5c-8633-77652cfdfe42 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:28.327897 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c1c16509-fd80-4c5c-8633-77652cfdfe42 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:28.336482 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c1c16509-fd80-4c5c-8633-77652cfdfe42 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:28.337921 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c1c16509-fd80-4c5c-8633-77652cfdfe42 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:28.339095 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c1c16509-fd80-4c5c-8633-77652cfdfe42 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1406 microversion: 2.20 time: 0.156416 May 16 15:21:28.339649 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 391/781] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:28 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:28.653492 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-777a433b-b298-40f9-9ac2-12fabe09a930 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:28.658289 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-777a433b-b298-40f9-9ac2-12fabe09a930 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:28.662955 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-777a433b-b298-40f9-9ac2-12fabe09a930 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:28.663661 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-777a433b-b298-40f9-9ac2-12fabe09a930 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:28.664614 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-777a433b-b298-40f9-9ac2-12fabe09a930 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:28.665143 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-777a433b-b298-40f9-9ac2-12fabe09a930 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:28.849431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-777a433b-b298-40f9-9ac2-12fabe09a930 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:28.856855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-777a433b-b298-40f9-9ac2-12fabe09a930 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1278 microversion: 2.1 time: 0.207702 May 16 15:21:28.857707 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 391/782] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:28 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:28.917226 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-92ec2c5b-63ed-418d-8cf6-1cdebe8b00a1 req-9367131b-ff82-44a0-b706-03514052982e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebbe62e5-c4dc-4203-8f12-3c0802188ea4", "tag": "1d6a2295-76e4-4a50-b3f2-a26938aab948"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:28.927521 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-92ec2c5b-63ed-418d-8cf6-1cdebe8b00a1 req-9367131b-ff82-44a0-b706-03514052982e service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:28.936700 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-92ec2c5b-63ed-418d-8cf6-1cdebe8b00a1 req-9367131b-ff82-44a0-b706-03514052982e service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:28.940443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-92ec2c5b-63ed-418d-8cf6-1cdebe8b00a1 req-9367131b-ff82-44a0-b706-03514052982e service nova] Creating event network-changed:1d6a2295-76e4-4a50-b3f2-a26938aab948 for instance ebbe62e5-c4dc-4203-8f12-3c0802188ea4 on hv-cinder-79578 May 16 15:21:28.946455 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-92ec2c5b-63ed-418d-8cf6-1cdebe8b00a1 req-9367131b-ff82-44a0-b706-03514052982e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032797 May 16 15:21:28.947602 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 392/783] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:29.357294 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-283535ff-c974-48ab-83f6-923777a63d0d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:29.357958 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-283535ff-c974-48ab-83f6-923777a63d0d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:29.365215 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-283535ff-c974-48ab-83f6-923777a63d0d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:29.365660 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-283535ff-c974-48ab-83f6-923777a63d0d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:29.366489 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-283535ff-c974-48ab-83f6-923777a63d0d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:29.366922 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-283535ff-c974-48ab-83f6-923777a63d0d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:29.795854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-283535ff-c974-48ab-83f6-923777a63d0d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:29.804538 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-283535ff-c974-48ab-83f6-923777a63d0d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:29.806173 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-283535ff-c974-48ab-83f6-923777a63d0d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:29.807278 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-283535ff-c974-48ab-83f6-923777a63d0d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1406 microversion: 2.20 time: 0.454443 May 16 15:21:29.807838 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 392/784] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:29 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:29.875633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-36813464-3209-4cae-8386-dc0a91ccd1ae tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:29.876321 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-36813464-3209-4cae-8386-dc0a91ccd1ae tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:29.882735 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36813464-3209-4cae-8386-dc0a91ccd1ae tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:29.883234 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36813464-3209-4cae-8386-dc0a91ccd1ae tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:29.883986 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36813464-3209-4cae-8386-dc0a91ccd1ae tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:29.884437 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36813464-3209-4cae-8386-dc0a91ccd1ae tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:30.018793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-36813464-3209-4cae-8386-dc0a91ccd1ae tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:30.027455 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-36813464-3209-4cae-8386-dc0a91ccd1ae tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.156580 May 16 15:21:30.028028 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 393/785] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:29 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:30.825267 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6bdfb835-4877-4d82-8b65-22fab4b72497 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:30.825938 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6bdfb835-4877-4d82-8b65-22fab4b72497 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:30.832189 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bdfb835-4877-4d82-8b65-22fab4b72497 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:30.832635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bdfb835-4877-4d82-8b65-22fab4b72497 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:30.833391 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bdfb835-4877-4d82-8b65-22fab4b72497 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:30.833821 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bdfb835-4877-4d82-8b65-22fab4b72497 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:30.961973 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-45b77628-9830-4a9f-bb35-2cfb775287eb req-81b11557-6006-4013-b3f1-0a92c895d6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50535581-9ba0-49d7-83c8-5b46113c41f2", "tag": "87b37162-8505-4153-9400-d7df48f99a54"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:30.970384 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-45b77628-9830-4a9f-bb35-2cfb775287eb req-81b11557-6006-4013-b3f1-0a92c895d6df service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:30.970822 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-45b77628-9830-4a9f-bb35-2cfb775287eb req-81b11557-6006-4013-b3f1-0a92c895d6df service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:30.981601 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-45b77628-9830-4a9f-bb35-2cfb775287eb req-81b11557-6006-4013-b3f1-0a92c895d6df service nova] Creating event network-changed:87b37162-8505-4153-9400-d7df48f99a54 for instance 50535581-9ba0-49d7-83c8-5b46113c41f2 on hv-cinder-79578 May 16 15:21:30.986524 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-45b77628-9830-4a9f-bb35-2cfb775287eb req-81b11557-6006-4013-b3f1-0a92c895d6df service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028253 May 16 15:21:30.987218 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 394/786] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:31.041628 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6bdfb835-4877-4d82-8b65-22fab4b72497 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:31.045858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fa8132f1-6fcc-4e79-a1f1-524ebc4ee31b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:31.046799 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fa8132f1-6fcc-4e79-a1f1-524ebc4ee31b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:31.049828 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6bdfb835-4877-4d82-8b65-22fab4b72497 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:31.051394 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6bdfb835-4877-4d82-8b65-22fab4b72497 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:31.053663 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6bdfb835-4877-4d82-8b65-22fab4b72497 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1406 microversion: 2.20 time: 0.231867 May 16 15:21:31.055892 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa8132f1-6fcc-4e79-a1f1-524ebc4ee31b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:31.057039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa8132f1-6fcc-4e79-a1f1-524ebc4ee31b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:31.057896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa8132f1-6fcc-4e79-a1f1-524ebc4ee31b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:31.059168 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa8132f1-6fcc-4e79-a1f1-524ebc4ee31b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:31.062874 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 393/787] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:30 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:31.199999 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fa8132f1-6fcc-4e79-a1f1-524ebc4ee31b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:31.207541 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fa8132f1-6fcc-4e79-a1f1-524ebc4ee31b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.165853 May 16 15:21:31.208125 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 395/788] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:31 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:31.974890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-75000687-83f3-4f3b-af5d-749769f27008 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:31.976060 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-75000687-83f3-4f3b-af5d-749769f27008 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:31.982290 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75000687-83f3-4f3b-af5d-749769f27008 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:31.982727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75000687-83f3-4f3b-af5d-749769f27008 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:31.983487 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75000687-83f3-4f3b-af5d-749769f27008 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:31.983913 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75000687-83f3-4f3b-af5d-749769f27008 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.063631 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-75000687-83f3-4f3b-af5d-749769f27008 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lazy-loading 'services' on Instance uuid 06593e10-12ee-4a95-b2bb-2387e0e18934 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:21:32.071900 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-08cf87c7-d0ac-4c9e-93db-e5d7949211b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:32.072508 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-08cf87c7-d0ac-4c9e-93db-e5d7949211b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:32.078916 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08cf87c7-d0ac-4c9e-93db-e5d7949211b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.079365 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08cf87c7-d0ac-4c9e-93db-e5d7949211b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.080141 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08cf87c7-d0ac-4c9e-93db-e5d7949211b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.080574 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08cf87c7-d0ac-4c9e-93db-e5d7949211b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.211569 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-08cf87c7-d0ac-4c9e-93db-e5d7949211b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:32.219501 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-08cf87c7-d0ac-4c9e-93db-e5d7949211b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:32.221016 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-08cf87c7-d0ac-4c9e-93db-e5d7949211b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:32.222143 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-08cf87c7-d0ac-4c9e-93db-e5d7949211b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1406 microversion: 2.20 time: 0.154563 May 16 15:21:32.222814 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 396/789] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:32 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:21:32.227228 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b37386fe-f158-4e98-9309-669a655022c6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:32.227824 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b37386fe-f158-4e98-9309-669a655022c6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:32.233477 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b37386fe-f158-4e98-9309-669a655022c6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.233933 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b37386fe-f158-4e98-9309-669a655022c6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.234561 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-75000687-83f3-4f3b-af5d-749769f27008 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "DELETE /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934/os-volume_attachments/9856e5a1-1b6f-4716-800d-0ddc8e8d8aea" status: 202 len: 0 microversion: 2.1 time: 0.263305 May 16 15:21:32.234740 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b37386fe-f158-4e98-9309-669a655022c6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.235177 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b37386fe-f158-4e98-9309-669a655022c6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.235319 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 394/790] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:21:31 2022] DELETE /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934/os-volume_attachments/9856e5a1-1b6f-4716-800d-0ddc8e8d8aea => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:21:32.371332 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b37386fe-f158-4e98-9309-669a655022c6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:32.378698 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b37386fe-f158-4e98-9309-669a655022c6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.154940 May 16 15:21:32.379283 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 397/791] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:32 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:33.240432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3d0abb2f-a994-45b0-8126-788f93371c71 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:33.241151 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3d0abb2f-a994-45b0-8126-788f93371c71 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:33.247443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d0abb2f-a994-45b0-8126-788f93371c71 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:33.247887 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d0abb2f-a994-45b0-8126-788f93371c71 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:33.248648 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d0abb2f-a994-45b0-8126-788f93371c71 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:33.249081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d0abb2f-a994-45b0-8126-788f93371c71 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:33.381838 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3d0abb2f-a994-45b0-8126-788f93371c71 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:33.393177 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3d0abb2f-a994-45b0-8126-788f93371c71 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:33.395661 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3d0abb2f-a994-45b0-8126-788f93371c71 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:33.395968 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ac3da432-9138-463a-aabd-cf87729bfeba tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:33.396776 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ac3da432-9138-463a-aabd-cf87729bfeba tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:33.397810 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3d0abb2f-a994-45b0-8126-788f93371c71 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1406 microversion: 2.20 time: 0.162086 May 16 15:21:33.403045 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 395/792] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:33 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:33.404369 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac3da432-9138-463a-aabd-cf87729bfeba tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:33.404818 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac3da432-9138-463a-aabd-cf87729bfeba tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:33.405596 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac3da432-9138-463a-aabd-cf87729bfeba tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:33.406075 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac3da432-9138-463a-aabd-cf87729bfeba tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:33.544316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ac3da432-9138-463a-aabd-cf87729bfeba tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:33.551671 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ac3da432-9138-463a-aabd-cf87729bfeba tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.159546 May 16 15:21:33.552245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 398/793] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:33 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:33.635137 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-e4ed9ba4-e95e-4a88-8ead-b23273f588d5 req-5a3b674a-f3c3-45ad-979c-565a197b02de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535581-9ba0-49d7-83c8-5b46113c41f2", "name": "network-vif-plugged", "status": "completed", "tag": "87b37162-8505-4153-9400-d7df48f99a54"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:33.643117 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e4ed9ba4-e95e-4a88-8ead-b23273f588d5 req-5a3b674a-f3c3-45ad-979c-565a197b02de service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:33.643604 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e4ed9ba4-e95e-4a88-8ead-b23273f588d5 req-5a3b674a-f3c3-45ad-979c-565a197b02de service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:33.654213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-e4ed9ba4-e95e-4a88-8ead-b23273f588d5 req-5a3b674a-f3c3-45ad-979c-565a197b02de service nova] Creating event network-vif-plugged:87b37162-8505-4153-9400-d7df48f99a54 for instance 50535581-9ba0-49d7-83c8-5b46113c41f2 on hv-cinder-79578 May 16 15:21:33.659093 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-e4ed9ba4-e95e-4a88-8ead-b23273f588d5 req-5a3b674a-f3c3-45ad-979c-565a197b02de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027612 May 16 15:21:33.659648 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 396/794] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:34.395604 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bda7aeb9-e84f-48f7-b074-ee62e7074bf6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:34.396139 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bda7aeb9-e84f-48f7-b074-ee62e7074bf6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:34.403242 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bda7aeb9-e84f-48f7-b074-ee62e7074bf6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.403687 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bda7aeb9-e84f-48f7-b074-ee62e7074bf6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.404450 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bda7aeb9-e84f-48f7-b074-ee62e7074bf6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.404879 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bda7aeb9-e84f-48f7-b074-ee62e7074bf6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.417693 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e0ea9f53-953b-4828-913a-886cd058d41f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:34.418420 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e0ea9f53-953b-4828-913a-886cd058d41f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:34.424450 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e0ea9f53-953b-4828-913a-886cd058d41f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.424896 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e0ea9f53-953b-4828-913a-886cd058d41f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.425665 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e0ea9f53-953b-4828-913a-886cd058d41f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.426119 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e0ea9f53-953b-4828-913a-886cd058d41f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.429418 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bda7aeb9-e84f-48f7-b074-ee62e7074bf6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:21:34.553035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e0ea9f53-953b-4828-913a-886cd058d41f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:34.560804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e0ea9f53-953b-4828-913a-886cd058d41f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:34.562320 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e0ea9f53-953b-4828-913a-886cd058d41f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:34.563529 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e0ea9f53-953b-4828-913a-886cd058d41f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1406 microversion: 2.20 time: 0.150519 May 16 15:21:34.564065 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 397/795] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:34 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:21:34.568419 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2e3a5ba6-d709-470c-af7d-85769b9ff2b7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:34.569047 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2e3a5ba6-d709-470c-af7d-85769b9ff2b7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:34.575680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e3a5ba6-d709-470c-af7d-85769b9ff2b7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.576122 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e3a5ba6-d709-470c-af7d-85769b9ff2b7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.580003 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e3a5ba6-d709-470c-af7d-85769b9ff2b7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.580003 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e3a5ba6-d709-470c-af7d-85769b9ff2b7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.685461 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bda7aeb9-e84f-48f7-b074-ee62e7074bf6 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "DELETE /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 204 len: 0 microversion: 2.1 time: 0.293355 May 16 15:21:34.686175 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 399/796] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:21:34 2022] DELETE /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:21:34.694537 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-16d2d63a-a0e3-4382-8087-2d2a37fd74f4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:34.695232 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-16d2d63a-a0e3-4382-8087-2d2a37fd74f4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:34.701598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16d2d63a-a0e3-4382-8087-2d2a37fd74f4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.702079 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16d2d63a-a0e3-4382-8087-2d2a37fd74f4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.702862 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16d2d63a-a0e3-4382-8087-2d2a37fd74f4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.703297 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16d2d63a-a0e3-4382-8087-2d2a37fd74f4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.708357 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2e3a5ba6-d709-470c-af7d-85769b9ff2b7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:34.715739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2e3a5ba6-d709-470c-af7d-85769b9ff2b7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.150749 May 16 15:21:34.716302 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 398/797] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:34 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:34.834456 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-16d2d63a-a0e3-4382-8087-2d2a37fd74f4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:34.841870 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-16d2d63a-a0e3-4382-8087-2d2a37fd74f4 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1514 microversion: 2.1 time: 0.151346 May 16 15:21:34.842470 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 400/798] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:34 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:35.581667 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3421924b-382d-4ed1-86be-b7262efeeac1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:35.582315 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3421924b-382d-4ed1-86be-b7262efeeac1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:35.589181 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3421924b-382d-4ed1-86be-b7262efeeac1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.589631 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3421924b-382d-4ed1-86be-b7262efeeac1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.590430 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3421924b-382d-4ed1-86be-b7262efeeac1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.590868 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3421924b-382d-4ed1-86be-b7262efeeac1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.720233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3421924b-382d-4ed1-86be-b7262efeeac1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:35.728419 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3421924b-382d-4ed1-86be-b7262efeeac1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:35.729903 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3421924b-382d-4ed1-86be-b7262efeeac1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:35.731017 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3421924b-382d-4ed1-86be-b7262efeeac1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1406 microversion: 2.20 time: 0.153250 May 16 15:21:35.731560 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 399/799] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:35 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:35.732966 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6d41f4a8-b3b8-4018-83ae-ca0afa5a81dd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:35.733579 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6d41f4a8-b3b8-4018-83ae-ca0afa5a81dd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:35.740113 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6d41f4a8-b3b8-4018-83ae-ca0afa5a81dd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.740559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6d41f4a8-b3b8-4018-83ae-ca0afa5a81dd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.741316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6d41f4a8-b3b8-4018-83ae-ca0afa5a81dd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.741748 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6d41f4a8-b3b8-4018-83ae-ca0afa5a81dd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.858898 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-30ce506f-7651-4678-9862-409dc2e85efc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:35.859424 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-30ce506f-7651-4678-9862-409dc2e85efc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:35.865256 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30ce506f-7651-4678-9862-409dc2e85efc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.865701 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30ce506f-7651-4678-9862-409dc2e85efc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.866491 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30ce506f-7651-4678-9862-409dc2e85efc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.866921 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30ce506f-7651-4678-9862-409dc2e85efc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.867834 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6d41f4a8-b3b8-4018-83ae-ca0afa5a81dd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:35.875326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6d41f4a8-b3b8-4018-83ae-ca0afa5a81dd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.146137 May 16 15:21:35.875886 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 401/800] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:35 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:35.991457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-30ce506f-7651-4678-9862-409dc2e85efc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:35.999018 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-30ce506f-7651-4678-9862-409dc2e85efc tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1514 microversion: 2.1 time: 0.143991 May 16 15:21:35.999698 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 400/801] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:35 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:36.748922 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-18b58036-674f-4025-bdc0-403670b1d80a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:36.749547 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-18b58036-674f-4025-bdc0-403670b1d80a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:36.755774 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18b58036-674f-4025-bdc0-403670b1d80a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.756227 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18b58036-674f-4025-bdc0-403670b1d80a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.756969 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18b58036-674f-4025-bdc0-403670b1d80a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.757395 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18b58036-674f-4025-bdc0-403670b1d80a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.887168 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-18b58036-674f-4025-bdc0-403670b1d80a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:36.892432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7045d248-69c4-469c-900f-6fcc66dfa52f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:36.893084 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7045d248-69c4-469c-900f-6fcc66dfa52f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:36.896104 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-18b58036-674f-4025-bdc0-403670b1d80a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:36.897784 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-18b58036-674f-4025-bdc0-403670b1d80a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:36.898959 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-18b58036-674f-4025-bdc0-403670b1d80a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1406 microversion: 2.20 time: 0.154004 May 16 15:21:36.899509 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 402/802] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:36 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:36.900351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7045d248-69c4-469c-900f-6fcc66dfa52f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.900791 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7045d248-69c4-469c-900f-6fcc66dfa52f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.901584 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7045d248-69c4-469c-900f-6fcc66dfa52f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.902017 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7045d248-69c4-469c-900f-6fcc66dfa52f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:37.020786 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c9bb7091-0da0-4984-bb84-cbb8bdca18a1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:37.021309 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c9bb7091-0da0-4984-bb84-cbb8bdca18a1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:37.027755 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9bb7091-0da0-4984-bb84-cbb8bdca18a1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:37.028280 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9bb7091-0da0-4984-bb84-cbb8bdca18a1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:37.029061 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9bb7091-0da0-4984-bb84-cbb8bdca18a1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:37.029492 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9bb7091-0da0-4984-bb84-cbb8bdca18a1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:37.038675 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7045d248-69c4-469c-900f-6fcc66dfa52f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:37.046723 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7045d248-69c4-469c-900f-6fcc66dfa52f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.158137 May 16 15:21:37.047292 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 401/803] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:36 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:37.156993 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c9bb7091-0da0-4984-bb84-cbb8bdca18a1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:37.164294 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c9bb7091-0da0-4984-bb84-cbb8bdca18a1 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1514 microversion: 2.1 time: 0.147353 May 16 15:21:37.169734 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 403/804] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:37 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:37.916906 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-83f6edbb-dc6c-4099-ab75-92b0e38c0a4a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:37.917458 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-83f6edbb-dc6c-4099-ab75-92b0e38c0a4a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:37.923758 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-83f6edbb-dc6c-4099-ab75-92b0e38c0a4a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:37.924200 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-83f6edbb-dc6c-4099-ab75-92b0e38c0a4a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:37.924956 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-83f6edbb-dc6c-4099-ab75-92b0e38c0a4a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:37.925386 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-83f6edbb-dc6c-4099-ab75-92b0e38c0a4a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.051564 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-83f6edbb-dc6c-4099-ab75-92b0e38c0a4a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:38.060444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-83f6edbb-dc6c-4099-ab75-92b0e38c0a4a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:38.062002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-83f6edbb-dc6c-4099-ab75-92b0e38c0a4a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:38.063169 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-83f6edbb-dc6c-4099-ab75-92b0e38c0a4a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1598 microversion: 2.20 time: 0.150229 May 16 15:21:38.063707 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 402/805] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:21:37 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:38.063906 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-48931e48-6198-404f-9d62-8a9e79df546b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:38.064505 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-48931e48-6198-404f-9d62-8a9e79df546b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:38.071164 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48931e48-6198-404f-9d62-8a9e79df546b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:38.071609 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48931e48-6198-404f-9d62-8a9e79df546b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.072365 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48931e48-6198-404f-9d62-8a9e79df546b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:38.072793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48931e48-6198-404f-9d62-8a9e79df546b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.080619 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c1fef1ab-6b7e-40af-b9f3-bd92fe4f7170 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:38.081338 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c1fef1ab-6b7e-40af-b9f3-bd92fe4f7170 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:38.087013 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1fef1ab-6b7e-40af-b9f3-bd92fe4f7170 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:38.087463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1fef1ab-6b7e-40af-b9f3-bd92fe4f7170 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.088242 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1fef1ab-6b7e-40af-b9f3-bd92fe4f7170 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:38.088678 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1fef1ab-6b7e-40af-b9f3-bd92fe4f7170 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.162893 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c1fef1ab-6b7e-40af-b9f3-bd92fe4f7170 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.086145 May 16 15:21:38.163762 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 403/806] 10.222.0.44 () {60 vars in 1315 bytes} [Mon May 16 15:21:38 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:21:38.181307 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a3b67685-5e52-459f-9636-1c8bda53a205 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:38.182502 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a3b67685-5e52-459f-9636-1c8bda53a205 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:38.188500 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a3b67685-5e52-459f-9636-1c8bda53a205 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:38.188952 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a3b67685-5e52-459f-9636-1c8bda53a205 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.189724 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a3b67685-5e52-459f-9636-1c8bda53a205 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:38.190315 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a3b67685-5e52-459f-9636-1c8bda53a205 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.213054 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-48931e48-6198-404f-9d62-8a9e79df546b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:38.221256 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-48931e48-6198-404f-9d62-8a9e79df546b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.161065 May 16 15:21:38.221946 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 404/807] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:38 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:38.589172 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a3b67685-5e52-459f-9636-1c8bda53a205 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:38.596885 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a3b67685-5e52-459f-9636-1c8bda53a205 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1514 microversion: 2.1 time: 0.419276 May 16 15:21:38.597766 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 404/808] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:38 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:39.238738 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b7fefd50-5f0e-4ae4-8b4a-ce3030287adb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:39.245583 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b7fefd50-5f0e-4ae4-8b4a-ce3030287adb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:39.246670 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7fefd50-5f0e-4ae4-8b4a-ce3030287adb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.247116 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7fefd50-5f0e-4ae4-8b4a-ce3030287adb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.247881 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7fefd50-5f0e-4ae4-8b4a-ce3030287adb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.248311 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b7fefd50-5f0e-4ae4-8b4a-ce3030287adb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.381110 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b7fefd50-5f0e-4ae4-8b4a-ce3030287adb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:39.390048 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b7fefd50-5f0e-4ae4-8b4a-ce3030287adb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.155214 May 16 15:21:39.390655 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 405/809] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:39 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:39.459303 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-c2e17bc7-2434-4294-b0f3-b2892b31496f req-9abe84c2-5977-4e3f-85bf-63b58b259879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06593e10-12ee-4a95-b2bb-2387e0e18934", "name": "network-vif-deleted", "tag": "7b95ef5d-6e82-4fc6-b503-4d9ee45d1f26"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:39.469323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c2e17bc7-2434-4294-b0f3-b2892b31496f req-9abe84c2-5977-4e3f-85bf-63b58b259879 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.473808 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c2e17bc7-2434-4294-b0f3-b2892b31496f req-9abe84c2-5977-4e3f-85bf-63b58b259879 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.481672 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-c2e17bc7-2434-4294-b0f3-b2892b31496f req-9abe84c2-5977-4e3f-85bf-63b58b259879 service nova] Creating event network-vif-deleted:7b95ef5d-6e82-4fc6-b503-4d9ee45d1f26 for instance 06593e10-12ee-4a95-b2bb-2387e0e18934 on hv-cinder-79578 May 16 15:21:39.486963 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-c2e17bc7-2434-4294-b0f3-b2892b31496f req-9abe84c2-5977-4e3f-85bf-63b58b259879 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031531 May 16 15:21:39.488053 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 405/810] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:39.615551 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-471bea71-9a65-4904-8895-2a73977a3302 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:39.616166 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-471bea71-9a65-4904-8895-2a73977a3302 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:39.623156 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-471bea71-9a65-4904-8895-2a73977a3302 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.625813 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-471bea71-9a65-4904-8895-2a73977a3302 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.625813 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-471bea71-9a65-4904-8895-2a73977a3302 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.625813 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-471bea71-9a65-4904-8895-2a73977a3302 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.702929 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-471bea71-9a65-4904-8895-2a73977a3302 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e6e8acac7c447ba3885dcafb386050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec3267b0c548558b92318ec6179dca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:39.710470 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-471bea71-9a65-4904-8895-2a73977a3302 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 200 len: 1304 microversion: 2.1 time: 0.098962 May 16 15:21:39.711491 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 406/811] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:39 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:40.407727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb42b8f9-fc4a-4af4-a945-3da370364270 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:40.408620 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eb42b8f9-fc4a-4af4-a945-3da370364270 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:40.415988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb42b8f9-fc4a-4af4-a945-3da370364270 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.418382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb42b8f9-fc4a-4af4-a945-3da370364270 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.418382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb42b8f9-fc4a-4af4-a945-3da370364270 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.418382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb42b8f9-fc4a-4af4-a945-3da370364270 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.557813 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eb42b8f9-fc4a-4af4-a945-3da370364270 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:40.565503 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eb42b8f9-fc4a-4af4-a945-3da370364270 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.162014 May 16 15:21:40.574922 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 406/812] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:40 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:40.726652 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b0dbd3cf-1061-4ab0-9567-768a21c25667 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:40.727288 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b0dbd3cf-1061-4ab0-9567-768a21c25667 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] [instance: 06593e10-12ee-4a95-b2bb-2387e0e18934] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:40.733569 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0dbd3cf-1061-4ab0-9567-768a21c25667 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.734009 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0dbd3cf-1061-4ab0-9567-768a21c25667 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.734807 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0dbd3cf-1061-4ab0-9567-768a21c25667 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.735236 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0dbd3cf-1061-4ab0-9567-768a21c25667 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.748925 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-b0dbd3cf-1061-4ab0-9567-768a21c25667 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] HTTP exception thrown: Instance 06593e10-12ee-4a95-b2bb-2387e0e18934 could not be found. May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b0dbd3cf-1061-4ab0-9567-768a21c25667 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Request method failure captured: May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 HTTP/1.1 May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmuDd_3xn91aOuJjFAcgCsFvdwu4R0x8ajvCZfg_ZhSbMj3dc71fAmy6g9T4MP23xbo_EbY8xonBdegSo3fo4M0EKW912vi4IGJ8i1t46zFo8f6boA8kcYIv9BTyWTAFrYVFHC6ay2v1ncO0iGOQfE2XrYo_6B74_jUA_10uEVAh-Aw May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: f6ec3267b0c548558b92318ec6179dca May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2054816046 May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:21:40.750572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6ec3267b0c548558b92318ec6179dca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f6ec3267b0c548558b92318ec6179dca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6ec3267b0c548558b92318ec6179dca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f6ec3267b0c548558b92318ec6179dca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesSnapshotTestJSON-2054816046 May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: f6ec3267b0c548558b92318ec6179dca May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2054816046 May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesSnapshotTestJSON-2054816046-project May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: d9e6e8acac7c447ba3885dcafb386050 May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesSnapshotTestJSON-2054816046-project May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance 06593e10-12ee-4a95-b2bb-2387e0e18934 could not be found. May 16 15:21:40.752243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '06593e10-12ee-4a95-b2bb-2387e0e18934'} May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06593e10-12ee-4a95-b2bb-2387e0e18934 could not be found. May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:40.753039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06593e10-12ee-4a95-b2bb-2387e0e18934 could not be found. May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06593e10-12ee-4a95-b2bb-2387e0e18934 could not be found. May 16 15:21:40.754341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:21:40.755491 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b0dbd3cf-1061-4ab0-9567-768a21c25667 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] Returning 404 to user: Instance 06593e10-12ee-4a95-b2bb-2387e0e18934 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:40.755491 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b0dbd3cf-1061-4ab0-9567-768a21c25667 tempest-VolumesSnapshotTestJSON-2054816046 tempest-VolumesSnapshotTestJSON-2054816046-project] 10.222.0.44 "GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934" status: 404 len: 111 microversion: 2.1 time: 0.029205 May 16 15:21:40.755491 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 407/813] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:40 2022] GET /compute/v2.1/servers/06593e10-12ee-4a95-b2bb-2387e0e18934 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:41.514852 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-766bc2c2-d884-46d1-8c15-086a7d3941c8 req-faae9ef1-fbac-4ad6-b71f-db1f6046e1ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50535581-9ba0-49d7-83c8-5b46113c41f2", "tag": "87b37162-8505-4153-9400-d7df48f99a54"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:41.523145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-766bc2c2-d884-46d1-8c15-086a7d3941c8 req-faae9ef1-fbac-4ad6-b71f-db1f6046e1ac service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.523584 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-766bc2c2-d884-46d1-8c15-086a7d3941c8 req-faae9ef1-fbac-4ad6-b71f-db1f6046e1ac service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.534948 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-766bc2c2-d884-46d1-8c15-086a7d3941c8 req-faae9ef1-fbac-4ad6-b71f-db1f6046e1ac service nova] Creating event network-changed:87b37162-8505-4153-9400-d7df48f99a54 for instance 50535581-9ba0-49d7-83c8-5b46113c41f2 on hv-cinder-79578 May 16 15:21:41.539794 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-766bc2c2-d884-46d1-8c15-086a7d3941c8 req-faae9ef1-fbac-4ad6-b71f-db1f6046e1ac service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028894 May 16 15:21:41.540566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 407/814] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:41.584516 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8ef8af05-db9e-41fc-a3a1-7507ac432a3a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:41.585245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8ef8af05-db9e-41fc-a3a1-7507ac432a3a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:41.591733 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8ef8af05-db9e-41fc-a3a1-7507ac432a3a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.592221 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8ef8af05-db9e-41fc-a3a1-7507ac432a3a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.593019 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8ef8af05-db9e-41fc-a3a1-7507ac432a3a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.593574 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8ef8af05-db9e-41fc-a3a1-7507ac432a3a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.634893 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-bac85868-ef5f-486f-9e2b-f6dbfcadb933 req-841d3019-b4c2-4ff9-be95-4253643acbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebbe62e5-c4dc-4203-8f12-3c0802188ea4", "name": "network-vif-plugged", "status": "completed", "tag": "1d6a2295-76e4-4a50-b3f2-a26938aab948"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:41.644881 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-bac85868-ef5f-486f-9e2b-f6dbfcadb933 req-841d3019-b4c2-4ff9-be95-4253643acbc4 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.645336 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-bac85868-ef5f-486f-9e2b-f6dbfcadb933 req-841d3019-b4c2-4ff9-be95-4253643acbc4 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.656896 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-bac85868-ef5f-486f-9e2b-f6dbfcadb933 req-841d3019-b4c2-4ff9-be95-4253643acbc4 service nova] Creating event network-vif-plugged:1d6a2295-76e4-4a50-b3f2-a26938aab948 for instance ebbe62e5-c4dc-4203-8f12-3c0802188ea4 on hv-cinder-79578 May 16 15:21:41.662323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-bac85868-ef5f-486f-9e2b-f6dbfcadb933 req-841d3019-b4c2-4ff9-be95-4253643acbc4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 May 16 15:21:41.662948 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 408/815] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:41.736506 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8ef8af05-db9e-41fc-a3a1-7507ac432a3a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:41.744286 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8ef8af05-db9e-41fc-a3a1-7507ac432a3a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.163590 May 16 15:21:41.744990 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 408/816] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:41 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:42.761746 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1660d1f2-64e1-4c6d-8e37-952cfc696817 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:42.762419 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1660d1f2-64e1-4c6d-8e37-952cfc696817 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:42.768422 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1660d1f2-64e1-4c6d-8e37-952cfc696817 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:42.768883 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1660d1f2-64e1-4c6d-8e37-952cfc696817 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:42.769636 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1660d1f2-64e1-4c6d-8e37-952cfc696817 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:42.770094 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1660d1f2-64e1-4c6d-8e37-952cfc696817 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:42.897453 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1660d1f2-64e1-4c6d-8e37-952cfc696817 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:42.905325 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1660d1f2-64e1-4c6d-8e37-952cfc696817 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.148274 May 16 15:21:42.905913 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 409/817] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:42 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:43.753630 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6ae8d226-0201-4bc2-b295-1a1588d1a57d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:43.754183 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6ae8d226-0201-4bc2-b295-1a1588d1a57d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:43.760484 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6ae8d226-0201-4bc2-b295-1a1588d1a57d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.760927 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6ae8d226-0201-4bc2-b295-1a1588d1a57d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.761680 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6ae8d226-0201-4bc2-b295-1a1588d1a57d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.762169 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6ae8d226-0201-4bc2-b295-1a1588d1a57d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.784767 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6ae8d226-0201-4bc2-b295-1a1588d1a57d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/ips" status: 200 len: 146 microversion: 2.1 time: 0.035015 May 16 15:21:43.785321 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 409/818] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 16 15:21:43 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:43.920922 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-de79589f-2501-4514-b9d2-5a4aeda24989 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:43.921452 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-de79589f-2501-4514-b9d2-5a4aeda24989 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:43.927699 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de79589f-2501-4514-b9d2-5a4aeda24989 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.928146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de79589f-2501-4514-b9d2-5a4aeda24989 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.928912 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de79589f-2501-4514-b9d2-5a4aeda24989 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.929348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de79589f-2501-4514-b9d2-5a4aeda24989 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:44.063514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-de79589f-2501-4514-b9d2-5a4aeda24989 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:44.071085 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-de79589f-2501-4514-b9d2-5a4aeda24989 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.154128 May 16 15:21:44.071650 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 410/819] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:43 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:45.088896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-29934e3a-225b-42dd-b06a-15eb0b8b3d59 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:45.090159 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-29934e3a-225b-42dd-b06a-15eb0b8b3d59 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:45.097504 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29934e3a-225b-42dd-b06a-15eb0b8b3d59 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.098317 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29934e3a-225b-42dd-b06a-15eb0b8b3d59 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.099186 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29934e3a-225b-42dd-b06a-15eb0b8b3d59 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.099696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29934e3a-225b-42dd-b06a-15eb0b8b3d59 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.229722 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-29934e3a-225b-42dd-b06a-15eb0b8b3d59 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:45.237274 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-29934e3a-225b-42dd-b06a-15eb0b8b3d59 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1266 microversion: 2.1 time: 0.152240 May 16 15:21:45.237837 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 410/820] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:45 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:46.254177 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-48e2935c-eb0a-473c-b6de-3f52ef254ed7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:46.254793 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-48e2935c-eb0a-473c-b6de-3f52ef254ed7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:46.261135 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48e2935c-eb0a-473c-b6de-3f52ef254ed7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.261588 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48e2935c-eb0a-473c-b6de-3f52ef254ed7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.262392 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48e2935c-eb0a-473c-b6de-3f52ef254ed7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.262835 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48e2935c-eb0a-473c-b6de-3f52ef254ed7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.356697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d64a2b9e-9f3e-41d4-97c4-dbc476567bcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63adfb36-bf76-4cd3-bcdd-2ef11e62ccb7"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:46.358348 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d64a2b9e-9f3e-41d4-97c4-dbc476567bcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:46.364662 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d64a2b9e-9f3e-41d4-97c4-dbc476567bcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.365118 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d64a2b9e-9f3e-41d4-97c4-dbc476567bcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.365887 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d64a2b9e-9f3e-41d4-97c4-dbc476567bcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.366350 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d64a2b9e-9f3e-41d4-97c4-dbc476567bcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.391996 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-48e2935c-eb0a-473c-b6de-3f52ef254ed7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:46.399927 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-48e2935c-eb0a-473c-b6de-3f52ef254ed7 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1453 microversion: 2.1 time: 0.149812 May 16 15:21:46.400755 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 411/821] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:46 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:46.415455 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-909009af-9423-4310-be82-fd0de9c20e54 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:46.416069 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-909009af-9423-4310-be82-fd0de9c20e54 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:46.422340 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-909009af-9423-4310-be82-fd0de9c20e54 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.422792 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-909009af-9423-4310-be82-fd0de9c20e54 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.423561 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-909009af-9423-4310-be82-fd0de9c20e54 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.423996 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-909009af-9423-4310-be82-fd0de9c20e54 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.564080 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-909009af-9423-4310-be82-fd0de9c20e54 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:46.571733 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-909009af-9423-4310-be82-fd0de9c20e54 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1453 microversion: 2.1 time: 0.159846 May 16 15:21:46.572298 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 412/822] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:21:46 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:47.147593 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d64a2b9e-9f3e-41d4-97c4-dbc476567bcd tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "POST /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794552 May 16 15:21:47.148135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 411/823] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:21:46 2022] POST /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:48.511608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-c3b0d6ff-f357-449d-be31-b0036b4300b5 req-26aa1383-4e1f-453b-bb80-f1f1dfb809f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebbe62e5-c4dc-4203-8f12-3c0802188ea4", "tag": "1d6a2295-76e4-4a50-b3f2-a26938aab948"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:48.520546 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c3b0d6ff-f357-449d-be31-b0036b4300b5 req-26aa1383-4e1f-453b-bb80-f1f1dfb809f0 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:48.520985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c3b0d6ff-f357-449d-be31-b0036b4300b5 req-26aa1383-4e1f-453b-bb80-f1f1dfb809f0 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.531991 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-c3b0d6ff-f357-449d-be31-b0036b4300b5 req-26aa1383-4e1f-453b-bb80-f1f1dfb809f0 service nova] Creating event network-changed:1d6a2295-76e4-4a50-b3f2-a26938aab948 for instance ebbe62e5-c4dc-4203-8f12-3c0802188ea4 on hv-cinder-79578 May 16 15:21:48.536794 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-c3b0d6ff-f357-449d-be31-b0036b4300b5 req-26aa1383-4e1f-453b-bb80-f1f1dfb809f0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028818 May 16 15:21:48.537404 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 413/824] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:56.731659 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7a6cd2cc-5916-49a0-9e18-b3b10c7e5fde tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:56.732691 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7a6cd2cc-5916-49a0-9e18-b3b10c7e5fde tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:56.739794 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7a6cd2cc-5916-49a0-9e18-b3b10c7e5fde tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.740239 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7a6cd2cc-5916-49a0-9e18-b3b10c7e5fde tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.740997 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7a6cd2cc-5916-49a0-9e18-b3b10c7e5fde tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.741425 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7a6cd2cc-5916-49a0-9e18-b3b10c7e5fde tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.770936 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7a6cd2cc-5916-49a0-9e18-b3b10c7e5fde tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 May 16 15:21:56.771491 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 412/825] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:21:56 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:56.782582 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fc3a6080-398d-4b9d-b2d1-c6fd06fcb9f2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:56.783162 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fc3a6080-398d-4b9d-b2d1-c6fd06fcb9f2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:56.789801 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc3a6080-398d-4b9d-b2d1-c6fd06fcb9f2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.790287 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc3a6080-398d-4b9d-b2d1-c6fd06fcb9f2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.791052 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc3a6080-398d-4b9d-b2d1-c6fd06fcb9f2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.791486 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc3a6080-398d-4b9d-b2d1-c6fd06fcb9f2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.822098 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fc3a6080-398d-4b9d-b2d1-c6fd06fcb9f2 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments/63adfb36-bf76-4cd3-bcdd-2ef11e62ccb7" status: 200 len: 194 microversion: 2.1 time: 0.044047 May 16 15:21:56.822526 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 414/826] 10.222.0.44 () {58 vars in 1412 bytes} [Mon May 16 15:21:56 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments/63adfb36-bf76-4cd3-bcdd-2ef11e62ccb7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:58.416671 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6d024024-8834-447f-8fea-cb4ac5b01fd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "926105fc-aaca-4fb7-bf3e-16b91da5fd8c"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:58.417721 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6d024024-8834-447f-8fea-cb4ac5b01fd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:58.423543 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6d024024-8834-447f-8fea-cb4ac5b01fd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:58.426532 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6d024024-8834-447f-8fea-cb4ac5b01fd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:58.426532 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6d024024-8834-447f-8fea-cb4ac5b01fd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:58.426532 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6d024024-8834-447f-8fea-cb4ac5b01fd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:59.284821 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6d024024-8834-447f-8fea-cb4ac5b01fd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "POST /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873002 May 16 15:21:59.285426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 413/827] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:21:58 2022] POST /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:04.217263 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-121304eb-760e-429e-a031-aea2cc77e346 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:04.217782 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-121304eb-760e-429e-a031-aea2cc77e346 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:04.223823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-121304eb-760e-429e-a031-aea2cc77e346 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:04.224273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-121304eb-760e-429e-a031-aea2cc77e346 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:04.226259 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-121304eb-760e-429e-a031-aea2cc77e346 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:04.226259 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-121304eb-760e-429e-a031-aea2cc77e346 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:04.248241 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-121304eb-760e-429e-a031-aea2cc77e346 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/ips" status: 200 len: 149 microversion: 2.1 time: 0.034873 May 16 15:22:04.248787 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 415/828] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 16 15:22:04 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:05.829796 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-46c1389b-3681-45fd-b801-7b4258be6413 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edc64ab6-1e27-42ee-b6b9-6167f44a64c8"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:05.830983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-46c1389b-3681-45fd-b801-7b4258be6413 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:05.837000 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46c1389b-3681-45fd-b801-7b4258be6413 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:05.837460 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46c1389b-3681-45fd-b801-7b4258be6413 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:05.838314 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46c1389b-3681-45fd-b801-7b4258be6413 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:05.838757 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46c1389b-3681-45fd-b801-7b4258be6413 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:06.768534 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-46c1389b-3681-45fd-b801-7b4258be6413 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "POST /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.943391 May 16 15:22:06.769105 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 414/829] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 16 15:22:05 2022] POST /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-volume_attachments => generated 194 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:07.811229 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-92d2021b-c19d-4f75-8cd2-cbeff9ff6b30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:07.812144 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-92d2021b-c19d-4f75-8cd2-cbeff9ff6b30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:07.818567 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92d2021b-c19d-4f75-8cd2-cbeff9ff6b30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:07.819009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92d2021b-c19d-4f75-8cd2-cbeff9ff6b30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:07.819765 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92d2021b-c19d-4f75-8cd2-cbeff9ff6b30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:07.820269 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92d2021b-c19d-4f75-8cd2-cbeff9ff6b30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:07.849869 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-92d2021b-c19d-4f75-8cd2-cbeff9ff6b30 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042734 May 16 15:22:07.851639 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 416/830] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:22:07 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:22:08.000895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-836b0eac-e473-42d4-ba1c-ab13933514a1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:08.001482 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-836b0eac-e473-42d4-ba1c-ab13933514a1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:08.007697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-836b0eac-e473-42d4-ba1c-ab13933514a1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.008141 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-836b0eac-e473-42d4-ba1c-ab13933514a1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.008958 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-836b0eac-e473-42d4-ba1c-ab13933514a1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.009356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-836b0eac-e473-42d4-ba1c-ab13933514a1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.038599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-836b0eac-e473-42d4-ba1c-ab13933514a1 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments/63adfb36-bf76-4cd3-bcdd-2ef11e62ccb7" status: 200 len: 194 microversion: 2.1 time: 0.042615 May 16 15:22:08.039192 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 415/831] 10.222.0.44 () {58 vars in 1412 bytes} [Mon May 16 15:22:07 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments/63adfb36-bf76-4cd3-bcdd-2ef11e62ccb7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:08.049035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-88288673-b720-4060-9a43-508222ef794f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:08.053162 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-88288673-b720-4060-9a43-508222ef794f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:08.055546 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88288673-b720-4060-9a43-508222ef794f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.055988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88288673-b720-4060-9a43-508222ef794f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.056752 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88288673-b720-4060-9a43-508222ef794f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.057182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88288673-b720-4060-9a43-508222ef794f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.134948 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-88288673-b720-4060-9a43-508222ef794f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lazy-loading 'services' on Instance uuid 981657e2-4b25-4a25-a9eb-562cdeb9efd6 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:22:08.388480 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-88288673-b720-4060-9a43-508222ef794f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "DELETE /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments/63adfb36-bf76-4cd3-bcdd-2ef11e62ccb7" status: 202 len: 0 microversion: 2.1 time: 0.343212 May 16 15:22:08.389016 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 417/832] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:22:08 2022] DELETE /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments/63adfb36-bf76-4cd3-bcdd-2ef11e62ccb7 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:22:15.383905 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c0d0cf42-9d11-4c5b-b21d-fd6ba70e6f83 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:15.384444 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c0d0cf42-9d11-4c5b-b21d-fd6ba70e6f83 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:15.390927 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c0d0cf42-9d11-4c5b-b21d-fd6ba70e6f83 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.391374 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c0d0cf42-9d11-4c5b-b21d-fd6ba70e6f83 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.392139 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c0d0cf42-9d11-4c5b-b21d-fd6ba70e6f83 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.392572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c0d0cf42-9d11-4c5b-b21d-fd6ba70e6f83 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.469588 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-c0d0cf42-9d11-4c5b-b21d-fd6ba70e6f83 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lazy-loading 'services' on Instance uuid 779684af-ad5e-4d00-9ea9-67d0c37dbdce {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:22:15.695055 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c0d0cf42-9d11-4c5b-b21d-fd6ba70e6f83 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-volume_attachments/edc64ab6-1e27-42ee-b6b9-6167f44a64c8" status: 202 len: 0 microversion: 2.1 time: 0.314907 May 16 15:22:15.695650 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 416/833] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:22:15 2022] DELETE /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-volume_attachments/edc64ab6-1e27-42ee-b6b9-6167f44a64c8 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:22:15.705299 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8ecf7432-541a-4cf6-a81b-a9b9b8c8bff9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:15.707912 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8ecf7432-541a-4cf6-a81b-a9b9b8c8bff9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:15.713910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ecf7432-541a-4cf6-a81b-a9b9b8c8bff9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.714542 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ecf7432-541a-4cf6-a81b-a9b9b8c8bff9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.715406 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ecf7432-541a-4cf6-a81b-a9b9b8c8bff9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.715712 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ecf7432-541a-4cf6-a81b-a9b9b8c8bff9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.748456 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8ecf7432-541a-4cf6-a81b-a9b9b8c8bff9 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048152 May 16 15:22:15.749008 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 418/834] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:22:15 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:15.961088 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-681faa76-e00a-46bd-aaa1-ec9af451e859 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:15.961660 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-681faa76-e00a-46bd-aaa1-ec9af451e859 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:15.967787 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-681faa76-e00a-46bd-aaa1-ec9af451e859 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.968233 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-681faa76-e00a-46bd-aaa1-ec9af451e859 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.968993 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-681faa76-e00a-46bd-aaa1-ec9af451e859 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.969419 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-681faa76-e00a-46bd-aaa1-ec9af451e859 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.992368 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-681faa76-e00a-46bd-aaa1-ec9af451e859 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/ips" status: 200 len: 151 microversion: 2.20 time: 0.035460 May 16 15:22:16.006478 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 417/835] 10.222.0.44 () {60 vars in 1288 bytes} [Mon May 16 15:22:15 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:22:16.761351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e761d56e-3503-480a-ae7c-69654f0f530d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:16.762319 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e761d56e-3503-480a-ae7c-69654f0f530d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:16.769917 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e761d56e-3503-480a-ae7c-69654f0f530d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:16.770400 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e761d56e-3503-480a-ae7c-69654f0f530d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:16.771197 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e761d56e-3503-480a-ae7c-69654f0f530d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:16.771623 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e761d56e-3503-480a-ae7c-69654f0f530d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:16.806165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e761d56e-3503-480a-ae7c-69654f0f530d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048419 May 16 15:22:16.807196 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 419/836] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:22:16 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:16.864048 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-46865602-ba46-462f-bd84-8ec02d0b35e6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:16.864670 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-46865602-ba46-462f-bd84-8ec02d0b35e6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:16.871372 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46865602-ba46-462f-bd84-8ec02d0b35e6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:16.871817 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46865602-ba46-462f-bd84-8ec02d0b35e6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:16.872583 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46865602-ba46-462f-bd84-8ec02d0b35e6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:16.873037 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46865602-ba46-462f-bd84-8ec02d0b35e6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:16.905373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-46865602-ba46-462f-bd84-8ec02d0b35e6 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments/926105fc-aaca-4fb7-bf3e-16b91da5fd8c" status: 200 len: 194 microversion: 2.1 time: 0.045640 May 16 15:22:16.907592 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 418/837] 10.222.0.44 () {58 vars in 1412 bytes} [Mon May 16 15:22:16 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments/926105fc-aaca-4fb7-bf3e-16b91da5fd8c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:16.916802 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e8f0ee3d-cdd3-410c-96bd-4fa6117b5f13 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:16.918485 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e8f0ee3d-cdd3-410c-96bd-4fa6117b5f13 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:16.923818 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8f0ee3d-cdd3-410c-96bd-4fa6117b5f13 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:16.924273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8f0ee3d-cdd3-410c-96bd-4fa6117b5f13 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:16.925096 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8f0ee3d-cdd3-410c-96bd-4fa6117b5f13 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:16.926085 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8f0ee3d-cdd3-410c-96bd-4fa6117b5f13 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.022445 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-e8f0ee3d-cdd3-410c-96bd-4fa6117b5f13 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lazy-loading 'services' on Instance uuid 981657e2-4b25-4a25-a9eb-562cdeb9efd6 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:22:17.243814 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e8f0ee3d-cdd3-410c-96bd-4fa6117b5f13 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "DELETE /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments/926105fc-aaca-4fb7-bf3e-16b91da5fd8c" status: 202 len: 0 microversion: 2.1 time: 0.331047 May 16 15:22:17.244431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 420/838] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 16 15:22:16 2022] DELETE /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments/926105fc-aaca-4fb7-bf3e-16b91da5fd8c => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:22:17.818617 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dcabba9a-06cb-4df0-81b6-d89548d0668c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:17.820258 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dcabba9a-06cb-4df0-81b6-d89548d0668c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:17.826436 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dcabba9a-06cb-4df0-81b6-d89548d0668c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.826887 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dcabba9a-06cb-4df0-81b6-d89548d0668c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.827655 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dcabba9a-06cb-4df0-81b6-d89548d0668c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.828084 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dcabba9a-06cb-4df0-81b6-d89548d0668c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.857281 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dcabba9a-06cb-4df0-81b6-d89548d0668c tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043397 May 16 15:22:17.857825 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 419/839] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:22:17 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:22:17.920179 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-324bc5ba-996d-462f-8223-7f3a59b83c29 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:17.920753 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-324bc5ba-996d-462f-8223-7f3a59b83c29 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:17.927601 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-324bc5ba-996d-462f-8223-7f3a59b83c29 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.928120 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-324bc5ba-996d-462f-8223-7f3a59b83c29 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.928900 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-324bc5ba-996d-462f-8223-7f3a59b83c29 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.929308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-324bc5ba-996d-462f-8223-7f3a59b83c29 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.954001 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-324bc5ba-996d-462f-8223-7f3a59b83c29 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:22:18.304095 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-324bc5ba-996d-462f-8223-7f3a59b83c29 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 204 len: 0 microversion: 2.1 time: 0.388313 May 16 15:22:18.305018 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 421/840] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:22:17 2022] DELETE /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:22:18.312663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f3f3fa3f-8ff1-43d0-a75e-253b96753142 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:18.313275 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f3f3fa3f-8ff1-43d0-a75e-253b96753142 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:18.319772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3f3fa3f-8ff1-43d0-a75e-253b96753142 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.320222 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3f3fa3f-8ff1-43d0-a75e-253b96753142 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.321106 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3f3fa3f-8ff1-43d0-a75e-253b96753142 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.321576 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3f3fa3f-8ff1-43d0-a75e-253b96753142 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.407644 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2e86e475-58d7-43cb-a8e2-2c1a57c25c8d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:18.408700 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2e86e475-58d7-43cb-a8e2-2c1a57c25c8d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:18.415250 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e86e475-58d7-43cb-a8e2-2c1a57c25c8d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.415694 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e86e475-58d7-43cb-a8e2-2c1a57c25c8d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.416452 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e86e475-58d7-43cb-a8e2-2c1a57c25c8d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.416878 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e86e475-58d7-43cb-a8e2-2c1a57c25c8d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.445984 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2e86e475-58d7-43cb-a8e2-2c1a57c25c8d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042505 May 16 15:22:18.446577 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 422/841] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:22:18 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:22:18.454732 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f3f3fa3f-8ff1-43d0-a75e-253b96753142 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:18.462869 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f3f3fa3f-8ff1-43d0-a75e-253b96753142 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1682 microversion: 2.1 time: 0.154009 May 16 15:22:18.463439 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 420/842] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:18 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:18.845531 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6d08c6fe-4a29-48bd-870d-8c16ae81956e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:18.846082 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6d08c6fe-4a29-48bd-870d-8c16ae81956e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:18.851995 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d08c6fe-4a29-48bd-870d-8c16ae81956e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.852432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d08c6fe-4a29-48bd-870d-8c16ae81956e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.853182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d08c6fe-4a29-48bd-870d-8c16ae81956e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.853610 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d08c6fe-4a29-48bd-870d-8c16ae81956e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.875560 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-6d08c6fe-4a29-48bd-870d-8c16ae81956e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lazy-loading 'flavor' on Instance uuid 50535581-9ba0-49d7-83c8-5b46113c41f2 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:22:19.347317 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6d08c6fe-4a29-48bd-870d-8c16ae81956e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "POST /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/action" status: 202 len: 0 microversion: 2.20 time: 0.505500 May 16 15:22:19.347934 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 423/843] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 16 15:22:18 2022] POST /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 16 15:22:19.356518 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5060b263-af89-4c1e-8479-9e16d7a51c73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:19.357128 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5060b263-af89-4c1e-8479-9e16d7a51c73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:19.363496 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5060b263-af89-4c1e-8479-9e16d7a51c73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.364559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5060b263-af89-4c1e-8479-9e16d7a51c73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:19.365384 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5060b263-af89-4c1e-8479-9e16d7a51c73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.365770 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5060b263-af89-4c1e-8479-9e16d7a51c73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:19.457333 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d0889596-de60-4405-bccb-edb3f70af117 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:19.458355 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d0889596-de60-4405-bccb-edb3f70af117 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:19.464460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0889596-de60-4405-bccb-edb3f70af117 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.464904 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0889596-de60-4405-bccb-edb3f70af117 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:19.465661 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0889596-de60-4405-bccb-edb3f70af117 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.466141 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0889596-de60-4405-bccb-edb3f70af117 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:19.491391 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5060b263-af89-4c1e-8479-9e16d7a51c73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:19.495682 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d0889596-de60-4405-bccb-edb3f70af117 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042648 May 16 15:22:19.496240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 424/844] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:22:19 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:22:19.499481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5060b263-af89-4c1e-8479-9e16d7a51c73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:19.501019 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5060b263-af89-4c1e-8479-9e16d7a51c73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:19.502199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5060b263-af89-4c1e-8479-9e16d7a51c73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.149548 May 16 15:22:19.502752 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 421/845] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:19 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:19.503680 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-887fa87c-bd77-4efb-bc38-486f1f5deacb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:19.504274 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-887fa87c-bd77-4efb-bc38-486f1f5deacb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:19.509933 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-887fa87c-bd77-4efb-bc38-486f1f5deacb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.510413 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-887fa87c-bd77-4efb-bc38-486f1f5deacb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:19.511168 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-887fa87c-bd77-4efb-bc38-486f1f5deacb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.511596 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-887fa87c-bd77-4efb-bc38-486f1f5deacb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:19.638511 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-887fa87c-bd77-4efb-bc38-486f1f5deacb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:19.646709 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-887fa87c-bd77-4efb-bc38-486f1f5deacb tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1682 microversion: 2.1 time: 0.146466 May 16 15:22:19.647274 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 425/846] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:19 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:20.506826 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c406a289-d9d4-47c5-9278-be21444a9931 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:20.507751 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c406a289-d9d4-47c5-9278-be21444a9931 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:20.514072 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c406a289-d9d4-47c5-9278-be21444a9931 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.514539 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c406a289-d9d4-47c5-9278-be21444a9931 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.515307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c406a289-d9d4-47c5-9278-be21444a9931 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.516107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c406a289-d9d4-47c5-9278-be21444a9931 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.520437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c52692f-1632-4c17-a3e4-02c3f3f5a9c7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:20.521105 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c52692f-1632-4c17-a3e4-02c3f3f5a9c7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:20.527591 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c52692f-1632-4c17-a3e4-02c3f3f5a9c7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.528040 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c52692f-1632-4c17-a3e4-02c3f3f5a9c7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.528804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c52692f-1632-4c17-a3e4-02c3f3f5a9c7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.529237 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c52692f-1632-4c17-a3e4-02c3f3f5a9c7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.544914 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c406a289-d9d4-47c5-9278-be21444a9931 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042544 May 16 15:22:20.545905 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 422/847] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:22:20 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:22:20.650230 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-377f0af4-09d9-41bf-9c1f-c683015d8948 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:20.651146 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-377f0af4-09d9-41bf-9c1f-c683015d8948 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:20.659123 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-377f0af4-09d9-41bf-9c1f-c683015d8948 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.659664 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-377f0af4-09d9-41bf-9c1f-c683015d8948 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.660523 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-377f0af4-09d9-41bf-9c1f-c683015d8948 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.661030 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-377f0af4-09d9-41bf-9c1f-c683015d8948 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.689881 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-377f0af4-09d9-41bf-9c1f-c683015d8948 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043707 May 16 15:22:20.690578 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 423/848] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 16 15:22:20 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 15:22:20.695720 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a7dad308-0ece-4fe6-b086-6b5006d9ecdf tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:20.696858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a7dad308-0ece-4fe6-b086-6b5006d9ecdf tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:20.706677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7dad308-0ece-4fe6-b086-6b5006d9ecdf tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.706677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7dad308-0ece-4fe6-b086-6b5006d9ecdf tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.706677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7dad308-0ece-4fe6-b086-6b5006d9ecdf tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.706677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7dad308-0ece-4fe6-b086-6b5006d9ecdf tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.715431 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c52692f-1632-4c17-a3e4-02c3f3f5a9c7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:20.723576 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c52692f-1632-4c17-a3e4-02c3f3f5a9c7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:20.725799 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c52692f-1632-4c17-a3e4-02c3f3f5a9c7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:20.726974 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c52692f-1632-4c17-a3e4-02c3f3f5a9c7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.210730 May 16 15:22:20.727726 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 426/849] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:20 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:22:20.752577 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-39d8f115-5751-45fa-915a-381e43e3bf04 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:20.753081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-39d8f115-5751-45fa-915a-381e43e3bf04 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:20.759422 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39d8f115-5751-45fa-915a-381e43e3bf04 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.759876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39d8f115-5751-45fa-915a-381e43e3bf04 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.760778 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39d8f115-5751-45fa-915a-381e43e3bf04 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.761152 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39d8f115-5751-45fa-915a-381e43e3bf04 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.789806 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-39d8f115-5751-45fa-915a-381e43e3bf04 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:22:20.854928 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a7dad308-0ece-4fe6-b086-6b5006d9ecdf tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:20.862426 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a7dad308-0ece-4fe6-b086-6b5006d9ecdf tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1682 microversion: 2.1 time: 0.170788 May 16 15:22:20.863005 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 424/850] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:20 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:21.028655 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-39d8f115-5751-45fa-915a-381e43e3bf04 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "DELETE /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 204 len: 0 microversion: 2.1 time: 0.279605 May 16 15:22:21.035022 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 427/851] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:22:20 2022] DELETE /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 15:22:21.037581 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3ca6db9c-86fd-46f3-829d-895f926f02d8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:21.038225 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3ca6db9c-86fd-46f3-829d-895f926f02d8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:21.044195 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ca6db9c-86fd-46f3-829d-895f926f02d8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:21.046633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ca6db9c-86fd-46f3-829d-895f926f02d8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:21.046633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ca6db9c-86fd-46f3-829d-895f926f02d8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:21.046633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3ca6db9c-86fd-46f3-829d-895f926f02d8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:21.073875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-9cdad227-720e-4d6b-b091-96d9de656759 req-78e4df06-8167-4c6f-996e-9701dc23696b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779684af-ad5e-4d00-9ea9-67d0c37dbdce", "name": "network-vif-deleted", "tag": "74efad31-6e64-40bc-9867-6c6e7c294314"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:21.083322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-9cdad227-720e-4d6b-b091-96d9de656759 req-78e4df06-8167-4c6f-996e-9701dc23696b service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:21.084579 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-9cdad227-720e-4d6b-b091-96d9de656759 req-78e4df06-8167-4c6f-996e-9701dc23696b service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:21.099453 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-9cdad227-720e-4d6b-b091-96d9de656759 req-78e4df06-8167-4c6f-996e-9701dc23696b service nova] Creating event network-vif-deleted:74efad31-6e64-40bc-9867-6c6e7c294314 for instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce on hv-cinder-79578 May 16 15:22:21.104668 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-9cdad227-720e-4d6b-b091-96d9de656759 req-78e4df06-8167-4c6f-996e-9701dc23696b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035177 May 16 15:22:21.105420 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 428/852] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:22:21.180460 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3ca6db9c-86fd-46f3-829d-895f926f02d8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:21.188926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3ca6db9c-86fd-46f3-829d-895f926f02d8 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1673 microversion: 2.1 time: 0.155312 May 16 15:22:21.197087 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 425/853] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:21 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:21.746409 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-74fe09e9-ffb4-4457-ab30-787bfc5d6458 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:21.747208 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-74fe09e9-ffb4-4457-ab30-787bfc5d6458 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:21.753688 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74fe09e9-ffb4-4457-ab30-787bfc5d6458 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:21.754164 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74fe09e9-ffb4-4457-ab30-787bfc5d6458 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:21.754946 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74fe09e9-ffb4-4457-ab30-787bfc5d6458 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:21.755388 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74fe09e9-ffb4-4457-ab30-787bfc5d6458 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:21.879357 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7da74f4d-2172-42f3-a614-244d6db37186 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:21.880584 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7da74f4d-2172-42f3-a614-244d6db37186 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:21.887746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7da74f4d-2172-42f3-a614-244d6db37186 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:21.888198 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7da74f4d-2172-42f3-a614-244d6db37186 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:21.888980 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-74fe09e9-ffb4-4457-ab30-787bfc5d6458 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:21.889141 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7da74f4d-2172-42f3-a614-244d6db37186 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:21.889598 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7da74f4d-2172-42f3-a614-244d6db37186 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:21.898161 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-74fe09e9-ffb4-4457-ab30-787bfc5d6458 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:21.900720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-74fe09e9-ffb4-4457-ab30-787bfc5d6458 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:21.902169 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-74fe09e9-ffb4-4457-ab30-787bfc5d6458 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.160449 May 16 15:22:21.902925 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 429/854] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:21 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:21.955254 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7da74f4d-2172-42f3-a614-244d6db37186 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:21.963222 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7da74f4d-2172-42f3-a614-244d6db37186 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1614 microversion: 2.1 time: 0.087699 May 16 15:22:21.963796 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 426/855] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:21 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:22.213325 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c0df373d-6949-423a-b75a-eb918477b8d0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:22.213839 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c0df373d-6949-423a-b75a-eb918477b8d0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:22.219783 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0df373d-6949-423a-b75a-eb918477b8d0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:22.220229 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0df373d-6949-423a-b75a-eb918477b8d0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:22.220981 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0df373d-6949-423a-b75a-eb918477b8d0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:22.221411 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0df373d-6949-423a-b75a-eb918477b8d0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:22.347515 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c0df373d-6949-423a-b75a-eb918477b8d0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:22.354842 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c0df373d-6949-423a-b75a-eb918477b8d0 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1673 microversion: 2.1 time: 0.146055 May 16 15:22:22.355397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 430/856] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:22 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:22.921102 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-31b57a07-cebb-4714-9ddf-d5f2c07633dc tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:22.921704 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-31b57a07-cebb-4714-9ddf-d5f2c07633dc tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:22.928872 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31b57a07-cebb-4714-9ddf-d5f2c07633dc tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:22.929538 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31b57a07-cebb-4714-9ddf-d5f2c07633dc tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:22.930534 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31b57a07-cebb-4714-9ddf-d5f2c07633dc tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:22.931168 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31b57a07-cebb-4714-9ddf-d5f2c07633dc tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:22.979986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1bf14aff-1db2-46ff-8080-c286aa616629 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:22.981311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1bf14aff-1db2-46ff-8080-c286aa616629 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:22.987932 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1bf14aff-1db2-46ff-8080-c286aa616629 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:22.988692 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1bf14aff-1db2-46ff-8080-c286aa616629 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:22.989696 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1bf14aff-1db2-46ff-8080-c286aa616629 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:22.990922 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1bf14aff-1db2-46ff-8080-c286aa616629 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:23.026304 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1bf14aff-1db2-46ff-8080-c286aa616629 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:23.026761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1bf14aff-1db2-46ff-8080-c286aa616629 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:23.027214 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-1bf14aff-1db2-46ff-8080-c286aa616629 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lazy-loading 'fault' on Instance uuid 779684af-ad5e-4d00-9ea9-67d0c37dbdce {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:22:23.068678 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-31b57a07-cebb-4714-9ddf-d5f2c07633dc tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:23.076498 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-31b57a07-cebb-4714-9ddf-d5f2c07633dc tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:23.078016 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-31b57a07-cebb-4714-9ddf-d5f2c07633dc tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:23.079214 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-31b57a07-cebb-4714-9ddf-d5f2c07633dc tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.162293 May 16 15:22:23.080084 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 427/857] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:22 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:23.085918 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1bf14aff-1db2-46ff-8080-c286aa616629 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ffd5660baa40a7a3d6918cb5d31e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143bc5a616249a7beefc7b27962026b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:23.093056 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1bf14aff-1db2-46ff-8080-c286aa616629 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 200 len: 1332 microversion: 2.1 time: 0.116822 May 16 15:22:23.093622 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 431/858] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:22 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 1332 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:23.371583 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5641185b-91e3-4ba0-ae7a-a21845009d40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:23.372186 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5641185b-91e3-4ba0-ae7a-a21845009d40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:23.378037 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5641185b-91e3-4ba0-ae7a-a21845009d40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:23.378508 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5641185b-91e3-4ba0-ae7a-a21845009d40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:23.379265 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5641185b-91e3-4ba0-ae7a-a21845009d40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:23.379724 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5641185b-91e3-4ba0-ae7a-a21845009d40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:23.509540 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5641185b-91e3-4ba0-ae7a-a21845009d40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:23.517621 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5641185b-91e3-4ba0-ae7a-a21845009d40 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1673 microversion: 2.1 time: 0.149779 May 16 15:22:23.518552 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 428/859] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:23 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:23.806560 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-33931c98-285a-442a-9262-d2ce9c2fa2c0 req-aec277bd-b148-418b-b16e-22e2fd3b8695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981657e2-4b25-4a25-a9eb-562cdeb9efd6", "name": "network-vif-deleted", "tag": "3df0b4b3-062a-4219-b9ab-a32600518c32"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:23.814465 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-33931c98-285a-442a-9262-d2ce9c2fa2c0 req-aec277bd-b148-418b-b16e-22e2fd3b8695 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:23.814957 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-33931c98-285a-442a-9262-d2ce9c2fa2c0 req-aec277bd-b148-418b-b16e-22e2fd3b8695 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:23.826375 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-33931c98-285a-442a-9262-d2ce9c2fa2c0 req-aec277bd-b148-418b-b16e-22e2fd3b8695 service nova] Creating event network-vif-deleted:3df0b4b3-062a-4219-b9ab-a32600518c32 for instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 on hv-cinder-79578 May 16 15:22:23.832285 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-33931c98-285a-442a-9262-d2ce9c2fa2c0 req-aec277bd-b148-418b-b16e-22e2fd3b8695 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028974 May 16 15:22:23.832919 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 432/860] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:24.096777 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ce375aca-d64e-49c1-83b6-2655d9d7c689 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:24.097497 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ce375aca-d64e-49c1-83b6-2655d9d7c689 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:24.104511 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce375aca-d64e-49c1-83b6-2655d9d7c689 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.105032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce375aca-d64e-49c1-83b6-2655d9d7c689 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.105858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce375aca-d64e-49c1-83b6-2655d9d7c689 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.106402 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce375aca-d64e-49c1-83b6-2655d9d7c689 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.111718 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-95e2f63d-4163-41f0-a7fa-b5b046ba49f5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:24.112412 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-95e2f63d-4163-41f0-a7fa-b5b046ba49f5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:24.119958 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95e2f63d-4163-41f0-a7fa-b5b046ba49f5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.119958 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95e2f63d-4163-41f0-a7fa-b5b046ba49f5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.125059 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95e2f63d-4163-41f0-a7fa-b5b046ba49f5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.129071 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95e2f63d-4163-41f0-a7fa-b5b046ba49f5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.144185 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-95e2f63d-4163-41f0-a7fa-b5b046ba49f5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-95e2f63d-4163-41f0-a7fa-b5b046ba49f5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce HTTP/1.1 May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:24.148659 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:24.150221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '779684af-ad5e-4d00-9ea9-67d0c37dbdce'} May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:24.151009 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:24.152481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:24.154172 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-95e2f63d-4163-41f0-a7fa-b5b046ba49f5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:24.154172 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-95e2f63d-4163-41f0-a7fa-b5b046ba49f5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 404 len: 111 microversion: 2.1 time: 0.040483 May 16 15:22:24.154172 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 433/861] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:24 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:24.159454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1d3b4818-6fce-4c2d-8b1d-b212f1718d28 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '.version_select at 0x7fc9a72a6af0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:24.253129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ce375aca-d64e-49c1-83b6-2655d9d7c689 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:24.255261 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1d3b4818-6fce-4c2d-8b1d-b212f1718d28 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306909209" status: 202 len: 0 microversion: 2.1 time: 0.099720 May 16 15:22:24.256376 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 434/862] 10.222.0.44 () {58 vars in 1220 bytes} [Mon May 16 15:22:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306909209 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 15:22:24.263059 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ce375aca-d64e-49c1-83b6-2655d9d7c689 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:24.265177 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ce375aca-d64e-49c1-83b6-2655d9d7c689 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:24.266512 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ce375aca-d64e-49c1-83b6-2655d9d7c689 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.173667 May 16 15:22:24.269250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 429/863] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:24 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:24.535439 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a83e5bfc-9601-4a27-9289-aa1af740eb5b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:24.536412 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a83e5bfc-9601-4a27-9289-aa1af740eb5b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:24.543452 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a83e5bfc-9601-4a27-9289-aa1af740eb5b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.546243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a83e5bfc-9601-4a27-9289-aa1af740eb5b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.546243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a83e5bfc-9601-4a27-9289-aa1af740eb5b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.546243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a83e5bfc-9601-4a27-9289-aa1af740eb5b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.585981 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a83e5bfc-9601-4a27-9289-aa1af740eb5b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.586548 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a83e5bfc-9601-4a27-9289-aa1af740eb5b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.587193 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-a83e5bfc-9601-4a27-9289-aa1af740eb5b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lazy-loading 'fault' on Instance uuid 981657e2-4b25-4a25-a9eb-562cdeb9efd6 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:22:24.645474 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a83e5bfc-9601-4a27-9289-aa1af740eb5b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911ef817a1ee4790ad97e857a299fb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9703f082240542aa979c6b53052d77b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:24.654791 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a83e5bfc-9601-4a27-9289-aa1af740eb5b tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 200 len: 1327 microversion: 2.1 time: 0.123280 May 16 15:22:24.664816 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 435/864] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:24 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:25.290260 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d65f8e88-b756-4d86-af36-55912de5a790 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:25.290854 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d65f8e88-b756-4d86-af36-55912de5a790 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:25.297704 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d65f8e88-b756-4d86-af36-55912de5a790 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:25.298199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d65f8e88-b756-4d86-af36-55912de5a790 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:25.298949 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d65f8e88-b756-4d86-af36-55912de5a790 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:25.299373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d65f8e88-b756-4d86-af36-55912de5a790 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:25.584626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d65f8e88-b756-4d86-af36-55912de5a790 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:25.593034 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d65f8e88-b756-4d86-af36-55912de5a790 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:25.594557 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d65f8e88-b756-4d86-af36-55912de5a790 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:25.595691 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d65f8e88-b756-4d86-af36-55912de5a790 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.309418 May 16 15:22:25.596237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 430/865] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:25 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:25.672390 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9893f366-a7d0-4598-b0d8-4262dc8a88b9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:25.673006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9893f366-a7d0-4598-b0d8-4262dc8a88b9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:25.679504 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9893f366-a7d0-4598-b0d8-4262dc8a88b9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:25.680308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9893f366-a7d0-4598-b0d8-4262dc8a88b9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:25.681081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9893f366-a7d0-4598-b0d8-4262dc8a88b9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:25.681520 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9893f366-a7d0-4598-b0d8-4262dc8a88b9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:25.698331 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-9893f366-a7d0-4598-b0d8-4262dc8a88b9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] HTTP exception thrown: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9893f366-a7d0-4598-b0d8-4262dc8a88b9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Request method failure captured: May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 HTTP/1.1 May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqNr8Y2YNiGnPWwSwaoFcHssAT1-6Q5vev-2iY8r4SvqLz7G_ENUXfRFhESH5tATu1IuNdkrIV4RFv6v9RBXVAs64cGo_csl4PPeEYXaFMT3AW_yGf2XNKygGcVpihvYrL3gc-IifgEHg9nhI7_Gd9cSwT69tUqboU63hhakcbRm8A May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:25.700454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9703f082240542aa979c6b53052d77b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9703f082240542aa979c6b53052d77b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeTestJSON-419811486-project May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 911ef817a1ee4790ad97e857a299fb01 May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeTestJSON-419811486-project May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:25.702026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '981657e2-4b25-4a25-a9eb-562cdeb9efd6'} May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:25.706449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:25.708090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:25.709374 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9893f366-a7d0-4598-b0d8-4262dc8a88b9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Returning 404 to user: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:25.709374 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9893f366-a7d0-4598-b0d8-4262dc8a88b9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 404 len: 111 microversion: 2.1 time: 0.033714 May 16 15:22:25.709374 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 436/866] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:25 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:25.710761 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f0a17ebd-aa9e-47ed-abc8-8ca55f4b973d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '.version_select at 0x7fc9a6b271f0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:25.809478 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f0a17ebd-aa9e-47ed-abc8-8ca55f4b973d tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162943271" status: 202 len: 0 microversion: 2.1 time: 0.102469 May 16 15:22:25.810071 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 431/867] 10.222.0.44 () {58 vars in 1220 bytes} [Mon May 16 15:22:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162943271 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:22:26.268508 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-74fe0e86-06ac-4dd9-ac74-efeaa6c3dae2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:26.269025 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-74fe0e86-06ac-4dd9-ac74-efeaa6c3dae2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:26.274872 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74fe0e86-06ac-4dd9-ac74-efeaa6c3dae2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.275334 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74fe0e86-06ac-4dd9-ac74-efeaa6c3dae2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.276100 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74fe0e86-06ac-4dd9-ac74-efeaa6c3dae2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.276529 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74fe0e86-06ac-4dd9-ac74-efeaa6c3dae2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.289624 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-74fe0e86-06ac-4dd9-ac74-efeaa6c3dae2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-74fe0e86-06ac-4dd9-ac74-efeaa6c3dae2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce HTTP/1.1 May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:26.291199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:26.292854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '779684af-ad5e-4d00-9ea9-67d0c37dbdce'} May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:26.293745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:26.295154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:26.296617 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-74fe0e86-06ac-4dd9-ac74-efeaa6c3dae2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:26.296617 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-74fe0e86-06ac-4dd9-ac74-efeaa6c3dae2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 404 len: 111 microversion: 2.1 time: 0.027864 May 16 15:22:26.296617 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 437/868] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:22:26 2022] DELETE /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:26.301177 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e25cd6d2-7e88-48ba-9ebd-c8b99f97d986 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:26.301777 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e25cd6d2-7e88-48ba-9ebd-c8b99f97d986 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 779684af-ad5e-4d00-9ea9-67d0c37dbdce] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:26.308493 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e25cd6d2-7e88-48ba-9ebd-c8b99f97d986 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.308929 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e25cd6d2-7e88-48ba-9ebd-c8b99f97d986 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.309680 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e25cd6d2-7e88-48ba-9ebd-c8b99f97d986 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.310134 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e25cd6d2-7e88-48ba-9ebd-c8b99f97d986 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.323698 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-e25cd6d2-7e88-48ba-9ebd-c8b99f97d986 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e25cd6d2-7e88-48ba-9ebd-c8b99f97d986 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce HTTP/1.1 May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:22:26.326108 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:26.330780 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '779684af-ad5e-4d00-9ea9-67d0c37dbdce'} May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:26.331672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. May 16 15:22:26.333427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:26.335218 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e25cd6d2-7e88-48ba-9ebd-c8b99f97d986 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance 779684af-ad5e-4d00-9ea9-67d0c37dbdce could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:26.335218 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e25cd6d2-7e88-48ba-9ebd-c8b99f97d986 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce" status: 404 len: 111 microversion: 2.1 time: 0.029757 May 16 15:22:26.335218 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 432/869] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:26 2022] GET /compute/v2.1/servers/779684af-ad5e-4d00-9ea9-67d0c37dbdce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:22:26.613787 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-827519c1-e1ad-47e7-acb9-3340355a3d6d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:26.614449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-827519c1-e1ad-47e7-acb9-3340355a3d6d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:26.621220 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-827519c1-e1ad-47e7-acb9-3340355a3d6d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.621695 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-827519c1-e1ad-47e7-acb9-3340355a3d6d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.622502 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-827519c1-e1ad-47e7-acb9-3340355a3d6d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.622936 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-827519c1-e1ad-47e7-acb9-3340355a3d6d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.754767 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-827519c1-e1ad-47e7-acb9-3340355a3d6d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:26.762996 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-827519c1-e1ad-47e7-acb9-3340355a3d6d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:26.764634 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-827519c1-e1ad-47e7-acb9-3340355a3d6d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:26.765799 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-827519c1-e1ad-47e7-acb9-3340355a3d6d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.156049 May 16 15:22:26.766479 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 438/870] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:26 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:27.572812 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-10400a77-6964-4ffe-89cf-ecf9caf421fe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:27.573307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-10400a77-6964-4ffe-89cf-ecf9caf421fe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:27.579602 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10400a77-6964-4ffe-89cf-ecf9caf421fe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.580048 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10400a77-6964-4ffe-89cf-ecf9caf421fe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.580801 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10400a77-6964-4ffe-89cf-ecf9caf421fe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.581234 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-10400a77-6964-4ffe-89cf-ecf9caf421fe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.594178 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-10400a77-6964-4ffe-89cf-ecf9caf421fe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-10400a77-6964-4ffe-89cf-ecf9caf421fe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: DELETE /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec HTTP/1.1 May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:22:27.595697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:22:27.597295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '7914c5a4-73f7-4114-a4ec-d583fecff5ec'} May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:27.598382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:22:27.599828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:27.601287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-10400a77-6964-4ffe-89cf-ecf9caf421fe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:27.601287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-10400a77-6964-4ffe-89cf-ecf9caf421fe tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 404 len: 111 microversion: 2.1 time: 0.028732 May 16 15:22:27.601287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 433/871] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:22:27 2022] DELETE /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:27.605091 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-609feceb-74ba-4f73-8040-555ace0d97d5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:27.605695 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-609feceb-74ba-4f73-8040-555ace0d97d5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: 7914c5a4-73f7-4114-a4ec-d583fecff5ec] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:27.611566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-609feceb-74ba-4f73-8040-555ace0d97d5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.612006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-609feceb-74ba-4f73-8040-555ace0d97d5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.612749 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-609feceb-74ba-4f73-8040-555ace0d97d5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.613177 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-609feceb-74ba-4f73-8040-555ace0d97d5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.626732 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-609feceb-74ba-4f73-8040-555ace0d97d5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-609feceb-74ba-4f73-8040-555ace0d97d5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec HTTP/1.1 May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:27.628484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:22:27.630035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '7914c5a4-73f7-4114-a4ec-d583fecff5ec'} May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:27.631076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. May 16 15:22:27.633102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:27.634499 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-609feceb-74ba-4f73-8040-555ace0d97d5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance 7914c5a4-73f7-4114-a4ec-d583fecff5ec could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:27.634499 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-609feceb-74ba-4f73-8040-555ace0d97d5 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec" status: 404 len: 111 microversion: 2.1 time: 0.028501 May 16 15:22:27.634499 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 439/872] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:27 2022] GET /compute/v2.1/servers/7914c5a4-73f7-4114-a4ec-d583fecff5ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:27.638401 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0b84f39a-5f98-4703-a8ca-1779fcd206ed tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:27.638915 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0b84f39a-5f98-4703-a8ca-1779fcd206ed tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:27.644636 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b84f39a-5f98-4703-a8ca-1779fcd206ed tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.645080 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b84f39a-5f98-4703-a8ca-1779fcd206ed tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.645864 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b84f39a-5f98-4703-a8ca-1779fcd206ed tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.646321 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b84f39a-5f98-4703-a8ca-1779fcd206ed tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.659182 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-0b84f39a-5f98-4703-a8ca-1779fcd206ed tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0b84f39a-5f98-4703-a8ca-1779fcd206ed tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: DELETE /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab HTTP/1.1 May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:22:27.660677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:22:27.662252 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': 'e4a1a85a-fe23-4b81-a511-c153411ecfab'} May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:27.663248 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:22:27.664696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:27.666287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0b84f39a-5f98-4703-a8ca-1779fcd206ed tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:27.666287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0b84f39a-5f98-4703-a8ca-1779fcd206ed tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 404 len: 111 microversion: 2.1 time: 0.027309 May 16 15:22:27.666287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 434/873] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:22:27 2022] DELETE /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:27.669883 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6829a27a-ccc0-48d1-8930-344d62a2aac1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:27.670525 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6829a27a-ccc0-48d1-8930-344d62a2aac1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: e4a1a85a-fe23-4b81-a511-c153411ecfab] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:27.676399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6829a27a-ccc0-48d1-8930-344d62a2aac1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.676843 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6829a27a-ccc0-48d1-8930-344d62a2aac1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.677599 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6829a27a-ccc0-48d1-8930-344d62a2aac1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.678023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6829a27a-ccc0-48d1-8930-344d62a2aac1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.692443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-6829a27a-ccc0-48d1-8930-344d62a2aac1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6829a27a-ccc0-48d1-8930-344d62a2aac1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab HTTP/1.1 May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:27.694640 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:22:27.696311 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'e4a1a85a-fe23-4b81-a511-c153411ecfab'} May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:27.697240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. May 16 15:22:27.698708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:27.700494 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6829a27a-ccc0-48d1-8930-344d62a2aac1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance e4a1a85a-fe23-4b81-a511-c153411ecfab could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:27.700494 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6829a27a-ccc0-48d1-8930-344d62a2aac1 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab" status: 404 len: 111 microversion: 2.1 time: 0.029763 May 16 15:22:27.700494 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 440/874] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:27 2022] GET /compute/v2.1/servers/e4a1a85a-fe23-4b81-a511-c153411ecfab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:27.784701 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0af047ff-3c57-425b-80b6-82d1bb48fc82 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:27.785304 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0af047ff-3c57-425b-80b6-82d1bb48fc82 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:27.791694 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0af047ff-3c57-425b-80b6-82d1bb48fc82 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.792140 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0af047ff-3c57-425b-80b6-82d1bb48fc82 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.792910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0af047ff-3c57-425b-80b6-82d1bb48fc82 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.793339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0af047ff-3c57-425b-80b6-82d1bb48fc82 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.925097 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0af047ff-3c57-425b-80b6-82d1bb48fc82 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:27.933650 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0af047ff-3c57-425b-80b6-82d1bb48fc82 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:27.935250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0af047ff-3c57-425b-80b6-82d1bb48fc82 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:27.936489 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0af047ff-3c57-425b-80b6-82d1bb48fc82 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.155731 May 16 15:22:27.937070 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 435/875] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:27 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:28.945911 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc25f58c-b914-498d-871d-89c55d28e4a2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:28.946462 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dc25f58c-b914-498d-871d-89c55d28e4a2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:28.952854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc25f58c-b914-498d-871d-89c55d28e4a2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:28.953303 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc25f58c-b914-498d-871d-89c55d28e4a2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:28.954104 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc25f58c-b914-498d-871d-89c55d28e4a2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:28.954365 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c04c4aab-0e50-4df5-8ee9-4dfbcfec6222 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:28.954767 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc25f58c-b914-498d-871d-89c55d28e4a2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:28.954970 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c04c4aab-0e50-4df5-8ee9-4dfbcfec6222 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:28.961187 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c04c4aab-0e50-4df5-8ee9-4dfbcfec6222 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:28.961632 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c04c4aab-0e50-4df5-8ee9-4dfbcfec6222 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:28.962464 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c04c4aab-0e50-4df5-8ee9-4dfbcfec6222 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:28.962893 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c04c4aab-0e50-4df5-8ee9-4dfbcfec6222 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:28.968314 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-dc25f58c-b914-498d-871d-89c55d28e4a2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc25f58c-b914-498d-871d-89c55d28e4a2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 HTTP/1.1 May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:28.970032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:22:28.971457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'dd44422c-b621-4ad8-82ab-e5eeae7b2633'} May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:28.973867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:22:28.976426 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:28.979790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc25f58c-b914-498d-871d-89c55d28e4a2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:28.979790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dc25f58c-b914-498d-871d-89c55d28e4a2 tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 404 len: 111 microversion: 2.1 time: 0.029338 May 16 15:22:28.979790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 441/876] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:22:28 2022] DELETE /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:28.979790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-911b0742-3c16-433d-aff5-e0d11554063d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:28.980157 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-911b0742-3c16-433d-aff5-e0d11554063d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] [instance: dd44422c-b621-4ad8-82ab-e5eeae7b2633] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:28.986023 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-911b0742-3c16-433d-aff5-e0d11554063d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:28.986502 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-911b0742-3c16-433d-aff5-e0d11554063d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:28.988000 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-911b0742-3c16-433d-aff5-e0d11554063d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:28.988200 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-911b0742-3c16-433d-aff5-e0d11554063d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.002240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-911b0742-3c16-433d-aff5-e0d11554063d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] HTTP exception thrown: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-911b0742-3c16-433d-aff5-e0d11554063d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Request method failure captured: May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 HTTP/1.1 May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqLH15fwHOIbxFqlgisyD3Af768Lzn_HAFE8ZF7Xev8x7jAIjvVH3-uJLk5GGdUkYvbQEeD9qXf7t9gV7nlZz1-gj2a3lsYQPiLORsI276dWxSJgKYhLDsJ6nTEBRJgL-ewAm-64qtmcYvUAUPvFxImq2i_iZJBSSJ1ZA7p68sQZh0 May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:29.004608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d143bc5a616249a7beefc7b27962026b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d143bc5a616249a7beefc7b27962026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: d143bc5a616249a7beefc7b27962026b May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1870556727 May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 44ffd5660baa40a7a3d6918cb5d31e56 May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-1870556727-project May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:22:29.006190 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'dd44422c-b621-4ad8-82ab-e5eeae7b2633'} May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:29.007097 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. May 16 15:22:29.008666 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.010684 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-911b0742-3c16-433d-aff5-e0d11554063d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] Returning 404 to user: Instance dd44422c-b621-4ad8-82ab-e5eeae7b2633 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:29.011525 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-911b0742-3c16-433d-aff5-e0d11554063d tempest-AttachVolumeNegativeTest-1870556727 tempest-AttachVolumeNegativeTest-1870556727-project] 10.222.0.44 "GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633" status: 404 len: 111 microversion: 2.1 time: 0.035653 May 16 15:22:29.012085 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 442/877] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:28 2022] GET /compute/v2.1/servers/dd44422c-b621-4ad8-82ab-e5eeae7b2633 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:22:29.016606 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e9ef561f-2c93-41b4-a801-9d3af2dfd1d4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:29.017090 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e9ef561f-2c93-41b4-a801-9d3af2dfd1d4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:29.023187 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9ef561f-2c93-41b4-a801-9d3af2dfd1d4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.023670 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9ef561f-2c93-41b4-a801-9d3af2dfd1d4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.024459 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9ef561f-2c93-41b4-a801-9d3af2dfd1d4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.024991 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e9ef561f-2c93-41b4-a801-9d3af2dfd1d4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.038890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-e9ef561f-2c93-41b4-a801-9d3af2dfd1d4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] HTTP exception thrown: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e9ef561f-2c93-41b4-a801-9d3af2dfd1d4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Request method failure captured: May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 HTTP/1.1 May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqNr8Y2YNiGnPWwSwaoFcHssAT1-6Q5vev-2iY8r4SvqLz7G_ENUXfRFhESH5tATu1IuNdkrIV4RFv6v9RBXVAs64cGo_csl4PPeEYXaFMT3AW_yGf2XNKygGcVpihvYrL3gc-IifgEHg9nhI7_Gd9cSwT69tUqboU63hhakcbRm8A May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:29.040444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9703f082240542aa979c6b53052d77b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9703f082240542aa979c6b53052d77b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeTestJSON-419811486-project May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 911ef817a1ee4790ad97e857a299fb01 May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeTestJSON-419811486-project May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:29.042107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '981657e2-4b25-4a25-a9eb-562cdeb9efd6'} May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:29.043033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:29.044573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.046732 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e9ef561f-2c93-41b4-a801-9d3af2dfd1d4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Returning 404 to user: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:29.046732 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e9ef561f-2c93-41b4-a801-9d3af2dfd1d4 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "DELETE /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 404 len: 111 microversion: 2.1 time: 0.028819 May 16 15:22:29.046732 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 443/878] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:22:29 2022] DELETE /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:29.054611 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0c45c8b3-89a1-4b2d-b95c-209226749b1f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:29.055210 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0c45c8b3-89a1-4b2d-b95c-209226749b1f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: 981657e2-4b25-4a25-a9eb-562cdeb9efd6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:29.064083 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c45c8b3-89a1-4b2d-b95c-209226749b1f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.064534 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c45c8b3-89a1-4b2d-b95c-209226749b1f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.067184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c45c8b3-89a1-4b2d-b95c-209226749b1f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.067184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c45c8b3-89a1-4b2d-b95c-209226749b1f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.083178 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-0c45c8b3-89a1-4b2d-b95c-209226749b1f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] HTTP exception thrown: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0c45c8b3-89a1-4b2d-b95c-209226749b1f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Request method failure captured: May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 HTTP/1.1 May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqNr8Y2YNiGnPWwSwaoFcHssAT1-6Q5vev-2iY8r4SvqLz7G_ENUXfRFhESH5tATu1IuNdkrIV4RFv6v9RBXVAs64cGo_csl4PPeEYXaFMT3AW_yGf2XNKygGcVpihvYrL3gc-IifgEHg9nhI7_Gd9cSwT69tUqboU63hhakcbRm8A May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:29.085771 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9703f082240542aa979c6b53052d77b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9703f082240542aa979c6b53052d77b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeTestJSON-419811486-project May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 911ef817a1ee4790ad97e857a299fb01 May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeTestJSON-419811486-project May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:29.087428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '981657e2-4b25-4a25-a9eb-562cdeb9efd6'} May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:29.088342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. May 16 15:22:29.089581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:29.090713 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0c45c8b3-89a1-4b2d-b95c-209226749b1f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Returning 404 to user: Instance 981657e2-4b25-4a25-a9eb-562cdeb9efd6 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:29.090713 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0c45c8b3-89a1-4b2d-b95c-209226749b1f tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6" status: 404 len: 111 microversion: 2.1 time: 0.036642 May 16 15:22:29.090713 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 444/879] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:29 2022] GET /compute/v2.1/servers/981657e2-4b25-4a25-a9eb-562cdeb9efd6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:29.115253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c04c4aab-0e50-4df5-8ee9-4dfbcfec6222 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:29.125136 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c04c4aab-0e50-4df5-8ee9-4dfbcfec6222 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:29.126564 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c04c4aab-0e50-4df5-8ee9-4dfbcfec6222 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:29.128448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c04c4aab-0e50-4df5-8ee9-4dfbcfec6222 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.178071 May 16 15:22:29.130899 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 436/880] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:28 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:22:30.147205 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-26c583a9-0613-4ae8-a992-4ad9df08e385 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:30.147820 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-26c583a9-0613-4ae8-a992-4ad9df08e385 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:30.154175 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26c583a9-0613-4ae8-a992-4ad9df08e385 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:30.154627 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26c583a9-0613-4ae8-a992-4ad9df08e385 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.155406 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26c583a9-0613-4ae8-a992-4ad9df08e385 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:30.155896 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26c583a9-0613-4ae8-a992-4ad9df08e385 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.312177 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6acb889f-5276-450a-b4ef-332339a19cd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:30.312684 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6acb889f-5276-450a-b4ef-332339a19cd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:30.318584 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-26c583a9-0613-4ae8-a992-4ad9df08e385 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:30.319400 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6acb889f-5276-450a-b4ef-332339a19cd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:30.319853 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6acb889f-5276-450a-b4ef-332339a19cd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.320631 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6acb889f-5276-450a-b4ef-332339a19cd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:30.321918 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6acb889f-5276-450a-b4ef-332339a19cd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.326534 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-26c583a9-0613-4ae8-a992-4ad9df08e385 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:30.328695 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-26c583a9-0613-4ae8-a992-4ad9df08e385 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:30.329865 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-26c583a9-0613-4ae8-a992-4ad9df08e385 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.186655 May 16 15:22:30.330447 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 445/881] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:30 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:30.335032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-6acb889f-5276-450a-b4ef-332339a19cd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] HTTP exception thrown: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6acb889f-5276-450a-b4ef-332339a19cd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Request method failure captured: May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: DELETE /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c HTTP/1.1 May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmqNr8Y2YNiGnPWwSwaoFcHssAT1-6Q5vev-2iY8r4SvqLz7G_ENUXfRFhESH5tATu1IuNdkrIV4RFv6v9RBXVAs64cGo_csl4PPeEYXaFMT3AW_yGf2XNKygGcVpihvYrL3gc-IifgEHg9nhI7_Gd9cSwT69tUqboU63hhakcbRm8A May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:22:30.336746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9703f082240542aa979c6b53052d77b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9703f082240542aa979c6b53052d77b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeTestJSON-419811486-project May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 911ef817a1ee4790ad97e857a299fb01 May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeTestJSON-419811486-project May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:22:30.338356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': 'f3e68f7e-80df-470a-869e-8c625ab4709c'} May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:30.339189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:22:30.340438 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:30.341707 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6acb889f-5276-450a-b4ef-332339a19cd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Returning 404 to user: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:30.341707 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6acb889f-5276-450a-b4ef-332339a19cd9 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 404 len: 111 microversion: 2.1 time: 0.030376 May 16 15:22:30.341707 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 437/882] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:22:30 2022] DELETE /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:22:30.346844 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-79a98194-989c-4477-b2d5-69da40a78709 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:30.347454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-79a98194-989c-4477-b2d5-69da40a78709 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] [instance: f3e68f7e-80df-470a-869e-8c625ab4709c] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:30.353234 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79a98194-989c-4477-b2d5-69da40a78709 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:30.353678 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79a98194-989c-4477-b2d5-69da40a78709 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.354480 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79a98194-989c-4477-b2d5-69da40a78709 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:30.354930 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79a98194-989c-4477-b2d5-69da40a78709 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.368145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-79a98194-989c-4477-b2d5-69da40a78709 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] HTTP exception thrown: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-79a98194-989c-4477-b2d5-69da40a78709 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Request method failure captured: May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c HTTP/1.1 May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmqNr8Y2YNiGnPWwSwaoFcHssAT1-6Q5vev-2iY8r4SvqLz7G_ENUXfRFhESH5tATu1IuNdkrIV4RFv6v9RBXVAs64cGo_csl4PPeEYXaFMT3AW_yGf2XNKygGcVpihvYrL3gc-IifgEHg9nhI7_Gd9cSwT69tUqboU63hhakcbRm8A May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:30.369727 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9703f082240542aa979c6b53052d77b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9703f082240542aa979c6b53052d77b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9703f082240542aa979c6b53052d77b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 9703f082240542aa979c6b53052d77b9 May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419811486 May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeTestJSON-419811486-project May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 911ef817a1ee4790ad97e857a299fb01 May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeTestJSON-419811486-project May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:22:30.371635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'f3e68f7e-80df-470a-869e-8c625ab4709c'} May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:30.372547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. May 16 15:22:30.375346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:30.376848 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-79a98194-989c-4477-b2d5-69da40a78709 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] Returning 404 to user: Instance f3e68f7e-80df-470a-869e-8c625ab4709c could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:30.376848 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-79a98194-989c-4477-b2d5-69da40a78709 tempest-AttachVolumeTestJSON-419811486 tempest-AttachVolumeTestJSON-419811486-project] 10.222.0.44 "GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c" status: 404 len: 111 microversion: 2.1 time: 0.028338 May 16 15:22:30.376848 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 446/883] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:22:30 2022] GET /compute/v2.1/servers/f3e68f7e-80df-470a-869e-8c625ab4709c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:31.349052 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-03cbceeb-75aa-4fbe-823a-98dc6daf3667 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:31.349604 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-03cbceeb-75aa-4fbe-823a-98dc6daf3667 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:31.356334 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03cbceeb-75aa-4fbe-823a-98dc6daf3667 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:31.357073 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03cbceeb-75aa-4fbe-823a-98dc6daf3667 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:31.358089 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03cbceeb-75aa-4fbe-823a-98dc6daf3667 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:31.358743 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03cbceeb-75aa-4fbe-823a-98dc6daf3667 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:31.570556 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-03cbceeb-75aa-4fbe-823a-98dc6daf3667 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:31.579374 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-03cbceeb-75aa-4fbe-823a-98dc6daf3667 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:31.580881 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-03cbceeb-75aa-4fbe-823a-98dc6daf3667 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:31.582286 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-03cbceeb-75aa-4fbe-823a-98dc6daf3667 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.237639 May 16 15:22:31.583024 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 438/884] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:31 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:32.600565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e98d8501-c06d-4d86-a45e-d7ad2c5de1e5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:32.601932 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e98d8501-c06d-4d86-a45e-d7ad2c5de1e5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:32.612411 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98d8501-c06d-4d86-a45e-d7ad2c5de1e5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:32.613243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98d8501-c06d-4d86-a45e-d7ad2c5de1e5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:32.614313 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98d8501-c06d-4d86-a45e-d7ad2c5de1e5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:32.614975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98d8501-c06d-4d86-a45e-d7ad2c5de1e5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:32.835476 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e98d8501-c06d-4d86-a45e-d7ad2c5de1e5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:32.849098 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e98d8501-c06d-4d86-a45e-d7ad2c5de1e5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:32.851149 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e98d8501-c06d-4d86-a45e-d7ad2c5de1e5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:32.852625 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e98d8501-c06d-4d86-a45e-d7ad2c5de1e5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.255896 May 16 15:22:32.853843 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 447/885] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:32 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:33.871775 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-06a930b5-d61c-46ad-8b9d-961ce74a3dde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:33.872365 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-06a930b5-d61c-46ad-8b9d-961ce74a3dde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:33.878781 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-06a930b5-d61c-46ad-8b9d-961ce74a3dde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:33.879236 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-06a930b5-d61c-46ad-8b9d-961ce74a3dde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:33.880185 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-06a930b5-d61c-46ad-8b9d-961ce74a3dde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:33.880623 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-06a930b5-d61c-46ad-8b9d-961ce74a3dde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:34.132428 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-06a930b5-d61c-46ad-8b9d-961ce74a3dde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:34.140563 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-06a930b5-d61c-46ad-8b9d-961ce74a3dde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:34.142466 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-06a930b5-d61c-46ad-8b9d-961ce74a3dde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:34.143632 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-06a930b5-d61c-46ad-8b9d-961ce74a3dde tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.276138 May 16 15:22:34.144185 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 439/886] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:33 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:35.162200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-404f3226-4ee5-42b9-91de-a9de599fecb6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:35.163481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-404f3226-4ee5-42b9-91de-a9de599fecb6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:35.170533 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-404f3226-4ee5-42b9-91de-a9de599fecb6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:35.171186 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-404f3226-4ee5-42b9-91de-a9de599fecb6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:35.171952 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-404f3226-4ee5-42b9-91de-a9de599fecb6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:35.172554 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-404f3226-4ee5-42b9-91de-a9de599fecb6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:35.213660 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b7b16f36-148b-43ae-8d60-4b74f5a384ef tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Action: 'create', calling method: .version_select at 0x7fc9a740e4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1982270435", "metadata": {"Type": "work"}}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b7b16f36-148b-43ae-8d60-4b74f5a384ef tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Request method failure captured: May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 122 May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmw6wOW6zh511GdgmtE2eGUZdj9Eltm7xOaWR2rQ3247fQ9P2UTgVC3QcY_rNSr3qHw6kdtLbid3z8YZ5JCwZerG6g2vNW5AIhVr1jQWngzinWdAGqJtFz7OpwQM9b__9rUUzAfOMIaBUwEaPSrHa3HtB4jn9Sc_xMqhhIIlTO5dod4 May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:35.226379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: a58ab314b90a45fcb0cd6b1fac1d1a45 May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1982270435", "metadata": {"Type": "work"}}} May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: May 16 15:22:35.228035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1982270435', 'metadata': {'Type': 'work'}}}} May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise error May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi '#$%' May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:35.233382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 15:22:35.234961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 15:22:35.236626 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 15:22:35.236626 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.236626 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b7b16f36-148b-43ae-8d60-4b74f5a384ef tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:35.236626 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b7b16f36-148b-43ae-8d60-4b74f5a384ef tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.183497 May 16 15:22:35.236626 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 448/887] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 16 15:22:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:22:35.237703 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-95adac41-2947-4b9e-aed0-e191d0652bd9 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Action: 'create', calling method: .version_select at 0x7fc9a74934c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-131642145", "metadata": {"Type": "work"}}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-95adac41-2947-4b9e-aed0-e191d0652bd9 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Request method failure captured: May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 119 May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmw6wOW6zh511GdgmtE2eGUZdj9Eltm7xOaWR2rQ3247fQ9P2UTgVC3QcY_rNSr3qHw6kdtLbid3z8YZ5JCwZerG6g2vNW5AIhVr1jQWngzinWdAGqJtFz7OpwQM9b__9rUUzAfOMIaBUwEaPSrHa3HtB4jn9Sc_xMqhhIIlTO5dod4 May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:35.240714 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: a58ab314b90a45fcb0cd6b1fac1d1a45 May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-131642145", "metadata": {"Type": "work"}}} May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: May 16 15:22:35.243076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-131642145', 'metadata': {'Type': 'work'}}}} May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise error May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi '0' May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:35.244075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 15:22:35.245468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 15:22:35.247112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 15:22:35.247112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.247112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-95adac41-2947-4b9e-aed0-e191d0652bd9 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:35.247112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-95adac41-2947-4b9e-aed0-e191d0652bd9 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008281 May 16 15:22:35.247112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 449/888] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 16 15:22:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 15:22:35.256062 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-889c8753-443b-4859-89ed-9c43c0f84e33 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Action: 'create', calling method: .version_select at 0x7fc9a73b9a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1867530364", "metadata": {"Type": "work"}}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-889c8753-443b-4859-89ed-9c43c0f84e33 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Request method failure captured: May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 119 May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmw6wOW6zh511GdgmtE2eGUZdj9Eltm7xOaWR2rQ3247fQ9P2UTgVC3QcY_rNSr3qHw6kdtLbid3z8YZ5JCwZerG6g2vNW5AIhVr1jQWngzinWdAGqJtFz7OpwQM9b__9rUUzAfOMIaBUwEaPSrHa3HtB4jn9Sc_xMqhhIIlTO5dod4 May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:35.256421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: a58ab314b90a45fcb0cd6b1fac1d1a45 May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1867530364", "metadata": {"Type": "work"}}} May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: May 16 15:22:35.261613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1867530364', 'metadata': {'Type': 'work'}}}} May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise error May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi '' May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:35.263154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 15:22:35.264786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 15:22:35.266332 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 15:22:35.266332 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.266332 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-889c8753-443b-4859-89ed-9c43c0f84e33 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:35.266332 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-889c8753-443b-4859-89ed-9c43c0f84e33 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007606 May 16 15:22:35.266332 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 450/889] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 16 15:22:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:22:35.268719 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-033d36c4-762b-4400-bc4a-150f2ece378f tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Calling method '.version_select at 0x7fc9a71c7160>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:35.299400 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-033d36c4-762b-4400-bc4a-150f2ece378f tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] HTTP exception thrown: Volume tempest-invalid-1886068283 could not be found. May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-033d36c4-762b-4400-bc4a-150f2ece378f tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Request method failure captured: May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1886068283 HTTP/1.1 May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmw6wOW6zh511GdgmtE2eGUZdj9Eltm7xOaWR2rQ3247fQ9P2UTgVC3QcY_rNSr3qHw6kdtLbid3z8YZ5JCwZerG6g2vNW5AIhVr1jQWngzinWdAGqJtFz7OpwQM9b__9rUUzAfOMIaBUwEaPSrHa3HtB4jn9Sc_xMqhhIIlTO5dod4 May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:35.310213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: a58ab314b90a45fcb0cd6b1fac1d1a45 May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Volume tempest-invalid-1886068283 could not be found. May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'tempest-invalid-1886068283'} May 16 15:22:35.311862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1886068283 could not be found. (HTTP 404) (Request-ID: req-b9e7dd53-247b-4c40-b3cf-8754daed2131) May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.312833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:22:35.314184 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1886068283 could not be found. May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:35.315488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1886068283 could not be found. May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1886068283 could not be found. May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-033d36c4-762b-4400-bc4a-150f2ece378f tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Returning 404 to user: Volume tempest-invalid-1886068283 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-033d36c4-762b-4400-bc4a-150f2ece378f tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1886068283" status: 404 len: 99 microversion: 2.1 time: 0.047392 May 16 15:22:35.316823 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 451/890] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 16 15:22:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1886068283 => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 16 15:22:35.322779 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-36db905e-10d5-414b-b0b2-b2c4ef882252 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004540 May 16 15:22:35.323273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 452/891] 10.222.0.44 () {58 vars in 1139 bytes} [Mon May 16 15:22:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 16 15:22:35.331547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-644d2834-9b4f-4213-a2a8-6fa60e6ae429 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003505 May 16 15:22:35.333180 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 453/892] 10.222.0.44 () {58 vars in 1136 bytes} [Mon May 16 15:22:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 16 15:22:35.340228 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-404f3226-4ee5-42b9-91de-a9de599fecb6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:35.347382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c34f70ac-76d1-49b5-b891-299bc16e9ac8 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Calling method '.version_select at 0x7fc9a738e040>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:35.349571 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-404f3226-4ee5-42b9-91de-a9de599fecb6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:35.351113 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-404f3226-4ee5-42b9-91de-a9de599fecb6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:35.352317 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-404f3226-4ee5-42b9-91de-a9de599fecb6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.194586 May 16 15:22:35.354297 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 440/893] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:35 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:35.368819 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-c34f70ac-76d1-49b5-b891-299bc16e9ac8 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] HTTP exception thrown: Volume 96db1cc8-5072-4c4e-aff7-ce091a437c2a could not be found. May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c34f70ac-76d1-49b5-b891-299bc16e9ac8 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Request method failure captured: May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/os-volumes/96db1cc8-5072-4c4e-aff7-ce091a437c2a HTTP/1.1 May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmw6wOW6zh511GdgmtE2eGUZdj9Eltm7xOaWR2rQ3247fQ9P2UTgVC3QcY_rNSr3qHw6kdtLbid3z8YZ5JCwZerG6g2vNW5AIhVr1jQWngzinWdAGqJtFz7OpwQM9b__9rUUzAfOMIaBUwEaPSrHa3HtB4jn9Sc_xMqhhIIlTO5dod4 May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:22:35.370798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: a58ab314b90a45fcb0cd6b1fac1d1a45 May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Volume 96db1cc8-5072-4c4e-aff7-ce091a437c2a could not be found. May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '96db1cc8-5072-4c4e-aff7-ce091a437c2a'} May 16 15:22:35.372418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96db1cc8-5072-4c4e-aff7-ce091a437c2a could not be found. (HTTP 404) (Request-ID: req-5f73a043-1604-4714-acbc-1f0258b97a58) May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.374580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:22:35.375975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96db1cc8-5072-4c4e-aff7-ce091a437c2a could not be found. May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 15:22:35.377243 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96db1cc8-5072-4c4e-aff7-ce091a437c2a could not be found. May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96db1cc8-5072-4c4e-aff7-ce091a437c2a could not be found. May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c34f70ac-76d1-49b5-b891-299bc16e9ac8 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Returning 404 to user: Volume 96db1cc8-5072-4c4e-aff7-ce091a437c2a could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c34f70ac-76d1-49b5-b891-299bc16e9ac8 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/96db1cc8-5072-4c4e-aff7-ce091a437c2a" status: 404 len: 109 microversion: 2.1 time: 0.034377 May 16 15:22:35.378928 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 454/894] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 16 15:22:35 2022] DELETE /compute/v2.1/os-volumes/96db1cc8-5072-4c4e-aff7-ce091a437c2a => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:35.383561 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e513671f-91a4-439a-92be-a9c58844ed50 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Calling method '.version_select at 0x7fc9a6c38c10>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:35.411430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-e513671f-91a4-439a-92be-a9c58844ed50 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] HTTP exception thrown: Volume 6278623f-558e-4374-92b7-ec2c10bf5284 could not be found. May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e513671f-91a4-439a-92be-a9c58844ed50 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Request method failure captured: May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/os-volumes/6278623f-558e-4374-92b7-ec2c10bf5284 HTTP/1.1 May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmw6wOW6zh511GdgmtE2eGUZdj9Eltm7xOaWR2rQ3247fQ9P2UTgVC3QcY_rNSr3qHw6kdtLbid3z8YZ5JCwZerG6g2vNW5AIhVr1jQWngzinWdAGqJtFz7OpwQM9b__9rUUzAfOMIaBUwEaPSrHa3HtB4jn9Sc_xMqhhIIlTO5dod4 May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:22:35.414663 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ce8ac7d37393427bb90ecf64c05ebf84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: ce8ac7d37393427bb90ecf64c05ebf84 May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesNegativeTest-434658171 May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: a58ab314b90a45fcb0cd6b1fac1d1a45 May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesNegativeTest-434658171-project May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Volume 6278623f-558e-4374-92b7-ec2c10bf5284 could not be found. May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '6278623f-558e-4374-92b7-ec2c10bf5284'} May 16 15:22:35.416250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6278623f-558e-4374-92b7-ec2c10bf5284 could not be found. (HTTP 404) (Request-ID: req-8df50c38-428e-459e-9ca3-7fed205e910c) May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.417240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:22:35.418452 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6278623f-558e-4374-92b7-ec2c10bf5284 could not be found. May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:22:35.419633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6278623f-558e-4374-92b7-ec2c10bf5284 could not be found. May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6278623f-558e-4374-92b7-ec2c10bf5284 could not be found. May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e513671f-91a4-439a-92be-a9c58844ed50 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] Returning 404 to user: Volume 6278623f-558e-4374-92b7-ec2c10bf5284 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e513671f-91a4-439a-92be-a9c58844ed50 tempest-VolumesNegativeTest-434658171 tempest-VolumesNegativeTest-434658171-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/6278623f-558e-4374-92b7-ec2c10bf5284" status: 404 len: 109 microversion: 2.1 time: 0.036644 May 16 15:22:35.420842 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 441/895] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:22:35 2022] GET /compute/v2.1/os-volumes/6278623f-558e-4374-92b7-ec2c10bf5284 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:36.371966 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6d3ff176-7ae1-4090-b613-74a9a9341d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:36.372573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6d3ff176-7ae1-4090-b613-74a9a9341d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:36.391102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d3ff176-7ae1-4090-b613-74a9a9341d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:36.391889 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d3ff176-7ae1-4090-b613-74a9a9341d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:36.392614 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d3ff176-7ae1-4090-b613-74a9a9341d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:36.393051 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d3ff176-7ae1-4090-b613-74a9a9341d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:36.523160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6d3ff176-7ae1-4090-b613-74a9a9341d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:36.532389 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6d3ff176-7ae1-4090-b613-74a9a9341d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:36.534876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6d3ff176-7ae1-4090-b613-74a9a9341d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:36.536076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6d3ff176-7ae1-4090-b613-74a9a9341d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.169024 May 16 15:22:36.536963 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 455/896] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:36 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:37.554772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-917300b6-a64e-4dfa-9336-2762ebc75532 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:37.555376 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-917300b6-a64e-4dfa-9336-2762ebc75532 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:37.562159 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-917300b6-a64e-4dfa-9336-2762ebc75532 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:37.562582 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-917300b6-a64e-4dfa-9336-2762ebc75532 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:37.564012 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-917300b6-a64e-4dfa-9336-2762ebc75532 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:37.564424 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-917300b6-a64e-4dfa-9336-2762ebc75532 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:37.695029 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-917300b6-a64e-4dfa-9336-2762ebc75532 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:37.702935 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-917300b6-a64e-4dfa-9336-2762ebc75532 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:37.704523 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-917300b6-a64e-4dfa-9336-2762ebc75532 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:37.705667 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-917300b6-a64e-4dfa-9336-2762ebc75532 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.155332 May 16 15:22:37.706247 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 442/897] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:37 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:38.723844 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ab9a4436-e6b9-4f09-acfd-dd9e003c96a4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:38.724434 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ab9a4436-e6b9-4f09-acfd-dd9e003c96a4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:38.731424 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab9a4436-e6b9-4f09-acfd-dd9e003c96a4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:38.731875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab9a4436-e6b9-4f09-acfd-dd9e003c96a4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:38.732651 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab9a4436-e6b9-4f09-acfd-dd9e003c96a4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:38.733084 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab9a4436-e6b9-4f09-acfd-dd9e003c96a4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:38.862573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ab9a4436-e6b9-4f09-acfd-dd9e003c96a4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:38.870346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ab9a4436-e6b9-4f09-acfd-dd9e003c96a4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:38.871822 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ab9a4436-e6b9-4f09-acfd-dd9e003c96a4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:38.872955 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ab9a4436-e6b9-4f09-acfd-dd9e003c96a4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.153179 May 16 15:22:38.874007 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 456/898] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:38 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:39.891976 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a5e7a819-5b95-4715-b016-0cca6b1991cf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:39.892584 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a5e7a819-5b95-4715-b016-0cca6b1991cf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:39.899150 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5e7a819-5b95-4715-b016-0cca6b1991cf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:39.899619 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5e7a819-5b95-4715-b016-0cca6b1991cf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:39.900368 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5e7a819-5b95-4715-b016-0cca6b1991cf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:39.900803 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a5e7a819-5b95-4715-b016-0cca6b1991cf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:40.035008 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a5e7a819-5b95-4715-b016-0cca6b1991cf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:40.043171 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a5e7a819-5b95-4715-b016-0cca6b1991cf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:40.044741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a5e7a819-5b95-4715-b016-0cca6b1991cf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:40.045933 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a5e7a819-5b95-4715-b016-0cca6b1991cf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.158354 May 16 15:22:40.046518 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 443/899] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:39 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:41.063478 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-54396849-c59f-432c-9d46-de387b0392b4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:41.064098 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-54396849-c59f-432c-9d46-de387b0392b4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:41.070499 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54396849-c59f-432c-9d46-de387b0392b4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:41.074933 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54396849-c59f-432c-9d46-de387b0392b4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:41.074933 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54396849-c59f-432c-9d46-de387b0392b4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:41.074933 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54396849-c59f-432c-9d46-de387b0392b4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:41.200377 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-54396849-c59f-432c-9d46-de387b0392b4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:41.208197 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-54396849-c59f-432c-9d46-de387b0392b4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:41.209687 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-54396849-c59f-432c-9d46-de387b0392b4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:41.210981 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-54396849-c59f-432c-9d46-de387b0392b4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1743 microversion: 2.20 time: 0.151447 May 16 15:22:41.211546 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 457/900] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:41 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:42.230539 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-feb1aa0d-30d6-4d81-8732-96ccee8be5af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:42.231143 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-feb1aa0d-30d6-4d81-8732-96ccee8be5af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:42.237360 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-feb1aa0d-30d6-4d81-8732-96ccee8be5af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:42.237805 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-feb1aa0d-30d6-4d81-8732-96ccee8be5af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:42.238593 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-feb1aa0d-30d6-4d81-8732-96ccee8be5af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:42.239080 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-feb1aa0d-30d6-4d81-8732-96ccee8be5af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:42.363316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-feb1aa0d-30d6-4d81-8732-96ccee8be5af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:42.371753 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-feb1aa0d-30d6-4d81-8732-96ccee8be5af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:42.373395 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-feb1aa0d-30d6-4d81-8732-96ccee8be5af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:42.374635 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-feb1aa0d-30d6-4d81-8732-96ccee8be5af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1743 microversion: 2.20 time: 0.148452 May 16 15:22:42.375262 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 444/901] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:42 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1743 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:22:43.392643 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-06a42d3d-2ba8-4d81-bbcb-8d78e95cd6ab tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:43.393239 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-06a42d3d-2ba8-4d81-bbcb-8d78e95cd6ab tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:43.399572 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06a42d3d-2ba8-4d81-bbcb-8d78e95cd6ab tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:43.400085 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06a42d3d-2ba8-4d81-bbcb-8d78e95cd6ab tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:43.400859 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06a42d3d-2ba8-4d81-bbcb-8d78e95cd6ab tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:43.401297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06a42d3d-2ba8-4d81-bbcb-8d78e95cd6ab tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:43.528214 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-06a42d3d-2ba8-4d81-bbcb-8d78e95cd6ab tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:43.536013 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-06a42d3d-2ba8-4d81-bbcb-8d78e95cd6ab tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:43.537495 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-06a42d3d-2ba8-4d81-bbcb-8d78e95cd6ab tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:43.538712 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-06a42d3d-2ba8-4d81-bbcb-8d78e95cd6ab tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1743 microversion: 2.20 time: 0.149981 May 16 15:22:43.539271 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 458/902] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:43 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:44.558604 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7a3232cc-bc21-499a-ab27-31df2ebeef9c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:44.559344 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7a3232cc-bc21-499a-ab27-31df2ebeef9c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:44.565863 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7a3232cc-bc21-499a-ab27-31df2ebeef9c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:44.566391 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7a3232cc-bc21-499a-ab27-31df2ebeef9c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:44.567113 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7a3232cc-bc21-499a-ab27-31df2ebeef9c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:44.567547 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7a3232cc-bc21-499a-ab27-31df2ebeef9c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:44.711720 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7a3232cc-bc21-499a-ab27-31df2ebeef9c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:44.719599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7a3232cc-bc21-499a-ab27-31df2ebeef9c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:44.721103 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7a3232cc-bc21-499a-ab27-31df2ebeef9c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:44.722263 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7a3232cc-bc21-499a-ab27-31df2ebeef9c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1743 microversion: 2.20 time: 0.168251 May 16 15:22:44.722806 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 445/903] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:44 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:45.745496 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-71a755cf-e8c2-4524-a2a1-4435346a028c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:45.747435 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-71a755cf-e8c2-4524-a2a1-4435346a028c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:45.754872 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71a755cf-e8c2-4524-a2a1-4435346a028c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:45.757441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71a755cf-e8c2-4524-a2a1-4435346a028c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:45.757441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71a755cf-e8c2-4524-a2a1-4435346a028c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:45.757441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71a755cf-e8c2-4524-a2a1-4435346a028c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:45.856539 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-056b157c-487c-42ab-b988-cb64f8dedf86 req-7469cbfb-cf4d-4ee1-965d-9143ca26cbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535581-9ba0-49d7-83c8-5b46113c41f2", "name": "network-vif-plugged", "status": "completed", "tag": "87b37162-8505-4153-9400-d7df48f99a54"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:45.867458 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-056b157c-487c-42ab-b988-cb64f8dedf86 req-7469cbfb-cf4d-4ee1-965d-9143ca26cbf9 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:45.868532 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-056b157c-487c-42ab-b988-cb64f8dedf86 req-7469cbfb-cf4d-4ee1-965d-9143ca26cbf9 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:45.890656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-056b157c-487c-42ab-b988-cb64f8dedf86 req-7469cbfb-cf4d-4ee1-965d-9143ca26cbf9 service nova] Creating event network-vif-plugged:87b37162-8505-4153-9400-d7df48f99a54 for instance 50535581-9ba0-49d7-83c8-5b46113c41f2 on hv-cinder-79578 May 16 15:22:45.898413 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-056b157c-487c-42ab-b988-cb64f8dedf86 req-7469cbfb-cf4d-4ee1-965d-9143ca26cbf9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046925 May 16 15:22:45.899729 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 446/904] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:45.912601 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-71a755cf-e8c2-4524-a2a1-4435346a028c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:45.920937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-71a755cf-e8c2-4524-a2a1-4435346a028c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:45.922678 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-71a755cf-e8c2-4524-a2a1-4435346a028c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:45.923974 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-71a755cf-e8c2-4524-a2a1-4435346a028c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1738 microversion: 2.20 time: 0.183621 May 16 15:22:45.924617 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 459/905] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:45 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:46.942224 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9c2485fe-6e8e-4712-810c-7c66a8e0ada8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:46.948544 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9c2485fe-6e8e-4712-810c-7c66a8e0ada8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:46.955682 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c2485fe-6e8e-4712-810c-7c66a8e0ada8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:46.956739 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c2485fe-6e8e-4712-810c-7c66a8e0ada8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:46.957749 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c2485fe-6e8e-4712-810c-7c66a8e0ada8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:46.959030 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c2485fe-6e8e-4712-810c-7c66a8e0ada8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:47.164231 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9c2485fe-6e8e-4712-810c-7c66a8e0ada8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:47.170650 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9c2485fe-6e8e-4712-810c-7c66a8e0ada8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:47.172337 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9c2485fe-6e8e-4712-810c-7c66a8e0ada8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:47.173818 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9c2485fe-6e8e-4712-810c-7c66a8e0ada8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1738 microversion: 2.20 time: 0.235652 May 16 15:22:47.174516 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 447/906] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:46 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:22:48.192745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d99edd29-2661-4d41-b1b9-cfcb587561a8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:48.193899 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d99edd29-2661-4d41-b1b9-cfcb587561a8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:48.201639 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d99edd29-2661-4d41-b1b9-cfcb587561a8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:48.202365 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d99edd29-2661-4d41-b1b9-cfcb587561a8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:48.203350 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d99edd29-2661-4d41-b1b9-cfcb587561a8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:48.203785 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d99edd29-2661-4d41-b1b9-cfcb587561a8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:48.426647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d99edd29-2661-4d41-b1b9-cfcb587561a8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:48.440161 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d99edd29-2661-4d41-b1b9-cfcb587561a8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:48.442316 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d99edd29-2661-4d41-b1b9-cfcb587561a8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:48.444117 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d99edd29-2661-4d41-b1b9-cfcb587561a8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1738 microversion: 2.20 time: 0.256185 May 16 15:22:48.446555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 460/907] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:48 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:49.464230 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c91a83ce-772c-4844-9b54-28dec6e31881 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:49.464988 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c91a83ce-772c-4844-9b54-28dec6e31881 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:49.471831 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c91a83ce-772c-4844-9b54-28dec6e31881 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:49.472385 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c91a83ce-772c-4844-9b54-28dec6e31881 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:49.473222 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c91a83ce-772c-4844-9b54-28dec6e31881 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:49.473664 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c91a83ce-772c-4844-9b54-28dec6e31881 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:49.625066 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c91a83ce-772c-4844-9b54-28dec6e31881 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:49.633332 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c91a83ce-772c-4844-9b54-28dec6e31881 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:49.634857 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c91a83ce-772c-4844-9b54-28dec6e31881 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:49.636462 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c91a83ce-772c-4844-9b54-28dec6e31881 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1738 microversion: 2.20 time: 0.176243 May 16 15:22:49.647719 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 448/908] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:49 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:50.655417 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-193017d0-9297-4c28-a3e3-717cf7a293a1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:50.656155 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-193017d0-9297-4c28-a3e3-717cf7a293a1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:50.663008 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-193017d0-9297-4c28-a3e3-717cf7a293a1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:50.663731 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-193017d0-9297-4c28-a3e3-717cf7a293a1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:50.664679 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-193017d0-9297-4c28-a3e3-717cf7a293a1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:50.665446 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-193017d0-9297-4c28-a3e3-717cf7a293a1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:50.877449 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-193017d0-9297-4c28-a3e3-717cf7a293a1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:50.893563 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-193017d0-9297-4c28-a3e3-717cf7a293a1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:50.899623 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-193017d0-9297-4c28-a3e3-717cf7a293a1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:50.904251 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-193017d0-9297-4c28-a3e3-717cf7a293a1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1738 microversion: 2.20 time: 0.250693 May 16 15:22:50.904840 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 461/909] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:50 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:51.923288 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-726b718d-d27f-4c54-a427-e2464416af4c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:51.925435 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-726b718d-d27f-4c54-a427-e2464416af4c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:51.932565 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-726b718d-d27f-4c54-a427-e2464416af4c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:51.933042 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-726b718d-d27f-4c54-a427-e2464416af4c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:51.933831 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-726b718d-d27f-4c54-a427-e2464416af4c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:51.934291 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-726b718d-d27f-4c54-a427-e2464416af4c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:52.085629 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-726b718d-d27f-4c54-a427-e2464416af4c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:52.093760 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-726b718d-d27f-4c54-a427-e2464416af4c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:52.095884 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-726b718d-d27f-4c54-a427-e2464416af4c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:52.097027 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-726b718d-d27f-4c54-a427-e2464416af4c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1738 microversion: 2.20 time: 0.177962 May 16 15:22:52.097568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 449/910] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:51 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:53.115446 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c495415c-35d7-48cc-bfd5-cdd2b105190c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:53.116214 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c495415c-35d7-48cc-bfd5-cdd2b105190c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:53.122481 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c495415c-35d7-48cc-bfd5-cdd2b105190c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:53.123102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c495415c-35d7-48cc-bfd5-cdd2b105190c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:53.124004 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c495415c-35d7-48cc-bfd5-cdd2b105190c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:53.124675 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c495415c-35d7-48cc-bfd5-cdd2b105190c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:53.299902 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c495415c-35d7-48cc-bfd5-cdd2b105190c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:53.308478 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c495415c-35d7-48cc-bfd5-cdd2b105190c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:53.310298 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c495415c-35d7-48cc-bfd5-cdd2b105190c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:53.311665 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c495415c-35d7-48cc-bfd5-cdd2b105190c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1738 microversion: 2.20 time: 0.200699 May 16 15:22:53.312221 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 462/911] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:53 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:54.332980 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ed96c993-6136-48f1-9f9d-72a8ac9427e6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:54.334124 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ed96c993-6136-48f1-9f9d-72a8ac9427e6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:54.340406 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed96c993-6136-48f1-9f9d-72a8ac9427e6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:54.348090 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed96c993-6136-48f1-9f9d-72a8ac9427e6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:54.348090 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed96c993-6136-48f1-9f9d-72a8ac9427e6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:54.348090 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed96c993-6136-48f1-9f9d-72a8ac9427e6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:54.504182 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ed96c993-6136-48f1-9f9d-72a8ac9427e6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:54.512837 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ed96c993-6136-48f1-9f9d-72a8ac9427e6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:54.516696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ed96c993-6136-48f1-9f9d-72a8ac9427e6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:54.516696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ed96c993-6136-48f1-9f9d-72a8ac9427e6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1738 microversion: 2.20 time: 0.186825 May 16 15:22:54.516696 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 450/912] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:54 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:55.534525 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2c247227-7e1f-4aa5-a47d-c54f3c664571 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:55.535080 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2c247227-7e1f-4aa5-a47d-c54f3c664571 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:55.541437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c247227-7e1f-4aa5-a47d-c54f3c664571 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:55.541878 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c247227-7e1f-4aa5-a47d-c54f3c664571 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:55.542671 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c247227-7e1f-4aa5-a47d-c54f3c664571 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:55.543102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c247227-7e1f-4aa5-a47d-c54f3c664571 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:55.677376 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2c247227-7e1f-4aa5-a47d-c54f3c664571 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:55.685484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2c247227-7e1f-4aa5-a47d-c54f3c664571 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:55.687146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2c247227-7e1f-4aa5-a47d-c54f3c664571 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:55.688322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2c247227-7e1f-4aa5-a47d-c54f3c664571 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1738 microversion: 2.20 time: 0.158609 May 16 15:22:55.688901 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 463/913] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:55 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:56.706277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9f51ad48-4293-4f6b-9ca9-7cb9ef7a8a91 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:56.706881 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9f51ad48-4293-4f6b-9ca9-7cb9ef7a8a91 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:56.713375 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f51ad48-4293-4f6b-9ca9-7cb9ef7a8a91 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:56.713858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f51ad48-4293-4f6b-9ca9-7cb9ef7a8a91 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:56.718314 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f51ad48-4293-4f6b-9ca9-7cb9ef7a8a91 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:56.718314 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f51ad48-4293-4f6b-9ca9-7cb9ef7a8a91 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:56.842101 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9f51ad48-4293-4f6b-9ca9-7cb9ef7a8a91 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:56.850725 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9f51ad48-4293-4f6b-9ca9-7cb9ef7a8a91 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:56.852220 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9f51ad48-4293-4f6b-9ca9-7cb9ef7a8a91 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:56.853380 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9f51ad48-4293-4f6b-9ca9-7cb9ef7a8a91 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1738 microversion: 2.20 time: 0.151567 May 16 15:22:56.853934 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 451/914] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:56 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:57.873903 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-946375e4-7d82-48cd-96fe-505dbe350cef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:57.874530 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-946375e4-7d82-48cd-96fe-505dbe350cef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:57.881064 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-946375e4-7d82-48cd-96fe-505dbe350cef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:57.881514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-946375e4-7d82-48cd-96fe-505dbe350cef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:57.882550 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-946375e4-7d82-48cd-96fe-505dbe350cef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:57.883158 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-946375e4-7d82-48cd-96fe-505dbe350cef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:58.372098 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-946375e4-7d82-48cd-96fe-505dbe350cef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:58.380748 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-946375e4-7d82-48cd-96fe-505dbe350cef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:58.382265 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-946375e4-7d82-48cd-96fe-505dbe350cef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:58.383567 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-946375e4-7d82-48cd-96fe-505dbe350cef tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1720 microversion: 2.20 time: 0.513845 May 16 15:22:58.384641 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 464/915] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:57 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1720 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:59.401849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2db063c9-9819-4b3f-a890-01508d0ccb18 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:59.402492 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2db063c9-9819-4b3f-a890-01508d0ccb18 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:59.409322 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2db063c9-9819-4b3f-a890-01508d0ccb18 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:59.409766 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2db063c9-9819-4b3f-a890-01508d0ccb18 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:59.410560 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2db063c9-9819-4b3f-a890-01508d0ccb18 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:59.410999 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2db063c9-9819-4b3f-a890-01508d0ccb18 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:59.539793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2db063c9-9819-4b3f-a890-01508d0ccb18 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:59.548094 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2db063c9-9819-4b3f-a890-01508d0ccb18 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:59.549580 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2db063c9-9819-4b3f-a890-01508d0ccb18 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:59.550762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2db063c9-9819-4b3f-a890-01508d0ccb18 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1720 microversion: 2.20 time: 0.152788 May 16 15:22:59.551324 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 452/916] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:22:59 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:59.837175 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-4f6c9400-0f2d-4b70-a642-ed3a6a81bad5 req-f14c36b0-c0d5-4812-b33a-35165db2efa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535581-9ba0-49d7-83c8-5b46113c41f2", "name": "network-vif-unplugged", "status": "completed", "tag": "87b37162-8505-4153-9400-d7df48f99a54"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:59.844384 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-4f6c9400-0f2d-4b70-a642-ed3a6a81bad5 req-f14c36b0-c0d5-4812-b33a-35165db2efa8 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:59.844830 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-4f6c9400-0f2d-4b70-a642-ed3a6a81bad5 req-f14c36b0-c0d5-4812-b33a-35165db2efa8 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:59.855887 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-4f6c9400-0f2d-4b70-a642-ed3a6a81bad5 req-f14c36b0-c0d5-4812-b33a-35165db2efa8 service nova] Creating event network-vif-unplugged:87b37162-8505-4153-9400-d7df48f99a54 for instance 50535581-9ba0-49d7-83c8-5b46113c41f2 on hv-cinder-79578 May 16 15:22:59.862567 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-4f6c9400-0f2d-4b70-a642-ed3a6a81bad5 req-f14c36b0-c0d5-4812-b33a-35165db2efa8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030007 May 16 15:22:59.862567 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 465/917] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:00.568754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f9fcfb17-f7f0-4c85-9307-818234ad424d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:00.569359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f9fcfb17-f7f0-4c85-9307-818234ad424d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:00.575618 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9fcfb17-f7f0-4c85-9307-818234ad424d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:00.576062 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9fcfb17-f7f0-4c85-9307-818234ad424d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:00.576817 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9fcfb17-f7f0-4c85-9307-818234ad424d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:00.577245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9fcfb17-f7f0-4c85-9307-818234ad424d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:00.709357 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f9fcfb17-f7f0-4c85-9307-818234ad424d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:00.717658 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f9fcfb17-f7f0-4c85-9307-818234ad424d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:00.719323 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f9fcfb17-f7f0-4c85-9307-818234ad424d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:00.720490 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f9fcfb17-f7f0-4c85-9307-818234ad424d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1723 microversion: 2.20 time: 0.155776 May 16 15:23:00.721573 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 453/918] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:00 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:00.741212 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c8028e40-942f-4186-8262-39c358c7bc14 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bc53503-f53f-46b5-938d-0d1bbb11b743"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:00.742434 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c8028e40-942f-4186-8262-39c358c7bc14 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:00.749154 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8028e40-942f-4186-8262-39c358c7bc14 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:00.749607 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8028e40-942f-4186-8262-39c358c7bc14 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:00.750406 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8028e40-942f-4186-8262-39c358c7bc14 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:00.750873 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8028e40-942f-4186-8262-39c358c7bc14 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:01.545075 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c8028e40-942f-4186-8262-39c358c7bc14 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "POST /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.808316 May 16 15:23:01.550427 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 466/919] 10.222.0.44 () {62 vars in 1363 bytes} [Mon May 16 15:23:00 2022] POST /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments => generated 188 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:23:01.730378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-aa7b5bcb-56e2-4687-a286-240718932dd3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:01.730946 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-aa7b5bcb-56e2-4687-a286-240718932dd3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:01.737433 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa7b5bcb-56e2-4687-a286-240718932dd3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:01.737958 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa7b5bcb-56e2-4687-a286-240718932dd3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:01.738784 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa7b5bcb-56e2-4687-a286-240718932dd3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:01.739221 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa7b5bcb-56e2-4687-a286-240718932dd3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:01.953563 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-aa7b5bcb-56e2-4687-a286-240718932dd3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "POST /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/action" status: 202 len: 0 microversion: 2.20 time: 0.227152 May 16 15:23:01.957342 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 454/920] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 16 15:23:01 2022] POST /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:23:01.962540 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-52660931-11f1-4d83-9b9a-d8cc5c2fcacf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:01.963157 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-52660931-11f1-4d83-9b9a-d8cc5c2fcacf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:01.970617 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52660931-11f1-4d83-9b9a-d8cc5c2fcacf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:01.971255 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52660931-11f1-4d83-9b9a-d8cc5c2fcacf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:01.972029 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52660931-11f1-4d83-9b9a-d8cc5c2fcacf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:01.972493 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52660931-11f1-4d83-9b9a-d8cc5c2fcacf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:02.105331 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-52660931-11f1-4d83-9b9a-d8cc5c2fcacf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:02.114216 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-52660931-11f1-4d83-9b9a-d8cc5c2fcacf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:02.116028 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-52660931-11f1-4d83-9b9a-d8cc5c2fcacf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:02.117178 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-52660931-11f1-4d83-9b9a-d8cc5c2fcacf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1749 microversion: 2.20 time: 0.158682 May 16 15:23:02.117743 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 467/921] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:01 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:03.135748 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2564f52f-4813-4352-a70a-2d95c625418a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:03.136354 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2564f52f-4813-4352-a70a-2d95c625418a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:03.157797 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2564f52f-4813-4352-a70a-2d95c625418a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:03.158283 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2564f52f-4813-4352-a70a-2d95c625418a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:03.159088 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2564f52f-4813-4352-a70a-2d95c625418a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:03.159520 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2564f52f-4813-4352-a70a-2d95c625418a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:03.294189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2564f52f-4813-4352-a70a-2d95c625418a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:03.302481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2564f52f-4813-4352-a70a-2d95c625418a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:03.304688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2564f52f-4813-4352-a70a-2d95c625418a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:03.305258 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2564f52f-4813-4352-a70a-2d95c625418a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1749 microversion: 2.20 time: 0.173925 May 16 15:23:03.305819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 455/922] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:03 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:04.324138 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7bb4e282-663f-48c5-ac56-ec8c52a449f0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:04.325227 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7bb4e282-663f-48c5-ac56-ec8c52a449f0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:04.331590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7bb4e282-663f-48c5-ac56-ec8c52a449f0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:04.332029 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7bb4e282-663f-48c5-ac56-ec8c52a449f0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:04.334134 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7bb4e282-663f-48c5-ac56-ec8c52a449f0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:04.334134 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7bb4e282-663f-48c5-ac56-ec8c52a449f0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:04.475342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7bb4e282-663f-48c5-ac56-ec8c52a449f0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:04.485333 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7bb4e282-663f-48c5-ac56-ec8c52a449f0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:04.489225 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7bb4e282-663f-48c5-ac56-ec8c52a449f0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:04.489225 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7bb4e282-663f-48c5-ac56-ec8c52a449f0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1751 microversion: 2.20 time: 0.167775 May 16 15:23:04.489225 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 468/923] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:04 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:05.507015 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-82cd62e6-f22c-4188-9481-430de8ca5218 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:05.507700 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-82cd62e6-f22c-4188-9481-430de8ca5218 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:05.514770 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82cd62e6-f22c-4188-9481-430de8ca5218 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:05.515290 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82cd62e6-f22c-4188-9481-430de8ca5218 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:05.516152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82cd62e6-f22c-4188-9481-430de8ca5218 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:05.516664 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82cd62e6-f22c-4188-9481-430de8ca5218 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:05.647454 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-82cd62e6-f22c-4188-9481-430de8ca5218 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:05.655776 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-82cd62e6-f22c-4188-9481-430de8ca5218 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:05.657278 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-82cd62e6-f22c-4188-9481-430de8ca5218 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:05.658440 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-82cd62e6-f22c-4188-9481-430de8ca5218 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1751 microversion: 2.20 time: 0.155336 May 16 15:23:05.658988 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 456/924] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:05 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:06.677188 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0fc4da69-593b-490c-b145-93d7d555c138 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:06.677820 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0fc4da69-593b-490c-b145-93d7d555c138 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:06.684087 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0fc4da69-593b-490c-b145-93d7d555c138 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:06.684529 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0fc4da69-593b-490c-b145-93d7d555c138 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:06.685313 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0fc4da69-593b-490c-b145-93d7d555c138 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:06.685740 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0fc4da69-593b-490c-b145-93d7d555c138 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:06.810351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0fc4da69-593b-490c-b145-93d7d555c138 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:06.818467 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0fc4da69-593b-490c-b145-93d7d555c138 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:06.819953 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0fc4da69-593b-490c-b145-93d7d555c138 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:06.821088 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0fc4da69-593b-490c-b145-93d7d555c138 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1751 microversion: 2.20 time: 0.147769 May 16 15:23:06.821641 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 469/925] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:06 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1751 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:07.839858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5dd7d57a-16cb-4df3-b3b0-04f08e45db3d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:07.840960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5dd7d57a-16cb-4df3-b3b0-04f08e45db3d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:07.847424 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5dd7d57a-16cb-4df3-b3b0-04f08e45db3d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:07.847871 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5dd7d57a-16cb-4df3-b3b0-04f08e45db3d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:07.848636 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5dd7d57a-16cb-4df3-b3b0-04f08e45db3d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:07.849070 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5dd7d57a-16cb-4df3-b3b0-04f08e45db3d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:07.975934 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5dd7d57a-16cb-4df3-b3b0-04f08e45db3d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:07.984320 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5dd7d57a-16cb-4df3-b3b0-04f08e45db3d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:07.985824 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5dd7d57a-16cb-4df3-b3b0-04f08e45db3d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:07.987008 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5dd7d57a-16cb-4df3-b3b0-04f08e45db3d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.151412 May 16 15:23:07.987569 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 457/926] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:07 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:09.010019 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-989b8b4a-3240-4e9b-80b8-90c745b75cbb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:09.010019 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-989b8b4a-3240-4e9b-80b8-90c745b75cbb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:09.012025 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-989b8b4a-3240-4e9b-80b8-90c745b75cbb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:09.012468 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-989b8b4a-3240-4e9b-80b8-90c745b75cbb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:09.013229 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-989b8b4a-3240-4e9b-80b8-90c745b75cbb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:09.013657 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-989b8b4a-3240-4e9b-80b8-90c745b75cbb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:09.139855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-989b8b4a-3240-4e9b-80b8-90c745b75cbb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:09.148287 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-989b8b4a-3240-4e9b-80b8-90c745b75cbb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:09.149801 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-989b8b4a-3240-4e9b-80b8-90c745b75cbb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:09.150975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-989b8b4a-3240-4e9b-80b8-90c745b75cbb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.150012 May 16 15:23:09.151526 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 470/927] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:08 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:10.169145 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-31952b9a-7322-40f8-b711-7220d266e6de tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:10.169743 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-31952b9a-7322-40f8-b711-7220d266e6de tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:10.176017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31952b9a-7322-40f8-b711-7220d266e6de tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:10.176460 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31952b9a-7322-40f8-b711-7220d266e6de tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:10.177213 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31952b9a-7322-40f8-b711-7220d266e6de tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:10.177639 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-31952b9a-7322-40f8-b711-7220d266e6de tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:10.305611 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-31952b9a-7322-40f8-b711-7220d266e6de tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:10.314756 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-31952b9a-7322-40f8-b711-7220d266e6de tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:10.316267 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-31952b9a-7322-40f8-b711-7220d266e6de tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:10.317422 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-31952b9a-7322-40f8-b711-7220d266e6de tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.152700 May 16 15:23:10.318214 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 458/928] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:10 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:11.336129 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fc8d4e91-8455-4b35-983d-54a6cf473e0a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:11.337103 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fc8d4e91-8455-4b35-983d-54a6cf473e0a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:11.343918 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8d4e91-8455-4b35-983d-54a6cf473e0a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:11.344444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8d4e91-8455-4b35-983d-54a6cf473e0a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:11.345279 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8d4e91-8455-4b35-983d-54a6cf473e0a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:11.345913 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8d4e91-8455-4b35-983d-54a6cf473e0a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:11.507376 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fc8d4e91-8455-4b35-983d-54a6cf473e0a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:11.516610 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fc8d4e91-8455-4b35-983d-54a6cf473e0a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:11.518470 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fc8d4e91-8455-4b35-983d-54a6cf473e0a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:11.519857 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fc8d4e91-8455-4b35-983d-54a6cf473e0a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.187614 May 16 15:23:11.520896 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 471/929] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:11 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:12.538245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7f601f78-7b5d-46be-aa2f-79d6aab910d2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:12.539915 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7f601f78-7b5d-46be-aa2f-79d6aab910d2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:12.555461 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f601f78-7b5d-46be-aa2f-79d6aab910d2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:12.555924 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f601f78-7b5d-46be-aa2f-79d6aab910d2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:12.556725 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f601f78-7b5d-46be-aa2f-79d6aab910d2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:12.557150 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f601f78-7b5d-46be-aa2f-79d6aab910d2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:12.828445 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7f601f78-7b5d-46be-aa2f-79d6aab910d2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:12.838948 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7f601f78-7b5d-46be-aa2f-79d6aab910d2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:12.841203 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7f601f78-7b5d-46be-aa2f-79d6aab910d2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:12.842472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7f601f78-7b5d-46be-aa2f-79d6aab910d2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.308189 May 16 15:23:12.843582 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 459/930] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:12 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:13.862138 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e3858d24-5bc6-4a37-8400-b2a86ebeed9d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:13.862786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e3858d24-5bc6-4a37-8400-b2a86ebeed9d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:13.876751 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3858d24-5bc6-4a37-8400-b2a86ebeed9d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:13.879828 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3858d24-5bc6-4a37-8400-b2a86ebeed9d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:13.884369 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3858d24-5bc6-4a37-8400-b2a86ebeed9d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:13.885022 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3858d24-5bc6-4a37-8400-b2a86ebeed9d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:14.054782 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e3858d24-5bc6-4a37-8400-b2a86ebeed9d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:14.066866 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e3858d24-5bc6-4a37-8400-b2a86ebeed9d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:14.068948 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e3858d24-5bc6-4a37-8400-b2a86ebeed9d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:14.071348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e3858d24-5bc6-4a37-8400-b2a86ebeed9d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.213056 May 16 15:23:14.071493 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 472/931] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:13 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:15.094235 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d0231ef5-ffa2-4441-905b-990973724ee0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:15.096191 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d0231ef5-ffa2-4441-905b-990973724ee0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:15.104540 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0231ef5-ffa2-4441-905b-990973724ee0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:15.105329 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0231ef5-ffa2-4441-905b-990973724ee0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:15.107111 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0231ef5-ffa2-4441-905b-990973724ee0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:15.107802 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0231ef5-ffa2-4441-905b-990973724ee0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:15.263215 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d0231ef5-ffa2-4441-905b-990973724ee0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:15.272021 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d0231ef5-ffa2-4441-905b-990973724ee0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:15.273806 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d0231ef5-ffa2-4441-905b-990973724ee0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:15.275159 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d0231ef5-ffa2-4441-905b-990973724ee0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.190224 May 16 15:23:15.275936 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 460/932] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:15 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:16.294467 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c1387ae5-2531-4df7-8b42-5c1a2b7407c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:16.295246 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c1387ae5-2531-4df7-8b42-5c1a2b7407c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:16.301953 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1387ae5-2531-4df7-8b42-5c1a2b7407c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:16.302509 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1387ae5-2531-4df7-8b42-5c1a2b7407c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:16.303396 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1387ae5-2531-4df7-8b42-5c1a2b7407c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:16.303934 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1387ae5-2531-4df7-8b42-5c1a2b7407c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:16.476053 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c1387ae5-2531-4df7-8b42-5c1a2b7407c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:16.487146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c1387ae5-2531-4df7-8b42-5c1a2b7407c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:16.489092 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c1387ae5-2531-4df7-8b42-5c1a2b7407c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:16.493593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c1387ae5-2531-4df7-8b42-5c1a2b7407c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.203668 May 16 15:23:16.494497 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 473/933] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:16 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:23:17.514533 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-12fb5bbd-a524-4cbc-90c0-0a55eab2bc47 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:17.516454 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-12fb5bbd-a524-4cbc-90c0-0a55eab2bc47 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:17.524267 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-12fb5bbd-a524-4cbc-90c0-0a55eab2bc47 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:17.524807 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-12fb5bbd-a524-4cbc-90c0-0a55eab2bc47 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:17.525941 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-12fb5bbd-a524-4cbc-90c0-0a55eab2bc47 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:17.526456 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-12fb5bbd-a524-4cbc-90c0-0a55eab2bc47 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:17.670951 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-12fb5bbd-a524-4cbc-90c0-0a55eab2bc47 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:17.685001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-12fb5bbd-a524-4cbc-90c0-0a55eab2bc47 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:17.686656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-12fb5bbd-a524-4cbc-90c0-0a55eab2bc47 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:17.688188 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-12fb5bbd-a524-4cbc-90c0-0a55eab2bc47 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.178992 May 16 15:23:17.688932 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 461/934] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:17 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:18.707586 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0a0da0de-a14b-4231-9dda-276ad81525ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:18.708164 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0a0da0de-a14b-4231-9dda-276ad81525ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:18.715345 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a0da0de-a14b-4231-9dda-276ad81525ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:18.715790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a0da0de-a14b-4231-9dda-276ad81525ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:18.716555 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a0da0de-a14b-4231-9dda-276ad81525ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:18.716988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a0da0de-a14b-4231-9dda-276ad81525ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:18.843658 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0a0da0de-a14b-4231-9dda-276ad81525ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:18.853250 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0a0da0de-a14b-4231-9dda-276ad81525ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:18.854927 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0a0da0de-a14b-4231-9dda-276ad81525ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:18.856208 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0a0da0de-a14b-4231-9dda-276ad81525ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.152786 May 16 15:23:18.856988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 474/935] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:18 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:19.875819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-da2e84d5-1dc1-49af-a0d0-04100739eb20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:19.877287 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-da2e84d5-1dc1-49af-a0d0-04100739eb20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:19.883873 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da2e84d5-1dc1-49af-a0d0-04100739eb20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:19.884731 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da2e84d5-1dc1-49af-a0d0-04100739eb20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:19.885726 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da2e84d5-1dc1-49af-a0d0-04100739eb20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:19.886430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da2e84d5-1dc1-49af-a0d0-04100739eb20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:20.033384 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-da2e84d5-1dc1-49af-a0d0-04100739eb20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:20.035232 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-da2e84d5-1dc1-49af-a0d0-04100739eb20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:20.036786 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-da2e84d5-1dc1-49af-a0d0-04100739eb20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:20.037983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-da2e84d5-1dc1-49af-a0d0-04100739eb20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.167222 May 16 15:23:20.038662 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 462/936] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:19 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:21.056631 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-18b84c04-ccae-499b-9986-dbc67b3c279f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:21.060829 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-18b84c04-ccae-499b-9986-dbc67b3c279f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:21.064322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-18b84c04-ccae-499b-9986-dbc67b3c279f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:21.064769 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-18b84c04-ccae-499b-9986-dbc67b3c279f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:21.065535 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-18b84c04-ccae-499b-9986-dbc67b3c279f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:21.066144 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-18b84c04-ccae-499b-9986-dbc67b3c279f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:21.197679 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-18b84c04-ccae-499b-9986-dbc67b3c279f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:21.206827 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-18b84c04-ccae-499b-9986-dbc67b3c279f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:21.208495 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-18b84c04-ccae-499b-9986-dbc67b3c279f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:21.209637 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-18b84c04-ccae-499b-9986-dbc67b3c279f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.157202 May 16 15:23:21.210210 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 475/937] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:21 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:22.229698 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7163f2c1-be3a-4b7f-b87d-68261d220180 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:22.231783 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7163f2c1-be3a-4b7f-b87d-68261d220180 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:22.244340 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7163f2c1-be3a-4b7f-b87d-68261d220180 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.245167 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7163f2c1-be3a-4b7f-b87d-68261d220180 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:22.245553 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7163f2c1-be3a-4b7f-b87d-68261d220180 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.245983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7163f2c1-be3a-4b7f-b87d-68261d220180 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:22.424562 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7163f2c1-be3a-4b7f-b87d-68261d220180 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:22.446095 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7163f2c1-be3a-4b7f-b87d-68261d220180 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:22.448160 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7163f2c1-be3a-4b7f-b87d-68261d220180 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:22.449946 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7163f2c1-be3a-4b7f-b87d-68261d220180 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.225544 May 16 15:23:22.450537 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 463/938] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:22 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:23:23.468447 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fb34d58c-b962-4795-ae64-498296e2945f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:23.468968 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fb34d58c-b962-4795-ae64-498296e2945f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:23.475229 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb34d58c-b962-4795-ae64-498296e2945f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:23.475671 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb34d58c-b962-4795-ae64-498296e2945f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:23.476425 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb34d58c-b962-4795-ae64-498296e2945f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:23.476855 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb34d58c-b962-4795-ae64-498296e2945f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:23.606979 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fb34d58c-b962-4795-ae64-498296e2945f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:23.615223 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fb34d58c-b962-4795-ae64-498296e2945f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:23.616719 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fb34d58c-b962-4795-ae64-498296e2945f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:23.617866 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fb34d58c-b962-4795-ae64-498296e2945f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.153884 May 16 15:23:23.618623 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 476/939] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:23 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:24.635691 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3b86961e-afce-4286-be41-32637b7a73ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:24.636295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3b86961e-afce-4286-be41-32637b7a73ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:24.642648 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b86961e-afce-4286-be41-32637b7a73ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:24.643097 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b86961e-afce-4286-be41-32637b7a73ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:24.643865 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b86961e-afce-4286-be41-32637b7a73ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:24.644298 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b86961e-afce-4286-be41-32637b7a73ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:24.774765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3b86961e-afce-4286-be41-32637b7a73ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:24.783793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3b86961e-afce-4286-be41-32637b7a73ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:24.785290 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3b86961e-afce-4286-be41-32637b7a73ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:24.786464 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3b86961e-afce-4286-be41-32637b7a73ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.154584 May 16 15:23:24.787009 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 464/940] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:24 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:25.804923 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ff188b1f-b8da-44d1-b38f-b3e2d22c88a9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:25.805553 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ff188b1f-b8da-44d1-b38f-b3e2d22c88a9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:25.812621 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff188b1f-b8da-44d1-b38f-b3e2d22c88a9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:25.813079 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff188b1f-b8da-44d1-b38f-b3e2d22c88a9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:25.813860 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff188b1f-b8da-44d1-b38f-b3e2d22c88a9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:25.814528 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff188b1f-b8da-44d1-b38f-b3e2d22c88a9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.024346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff188b1f-b8da-44d1-b38f-b3e2d22c88a9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:26.033683 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff188b1f-b8da-44d1-b38f-b3e2d22c88a9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:26.035293 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff188b1f-b8da-44d1-b38f-b3e2d22c88a9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:26.036512 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ff188b1f-b8da-44d1-b38f-b3e2d22c88a9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.235817 May 16 15:23:26.037096 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 477/941] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:25 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:27.054754 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c7228d8e-3281-41e3-83ba-7bda08eb9d9e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:27.055361 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c7228d8e-3281-41e3-83ba-7bda08eb9d9e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:27.061626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c7228d8e-3281-41e3-83ba-7bda08eb9d9e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:27.062114 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c7228d8e-3281-41e3-83ba-7bda08eb9d9e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:27.062880 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c7228d8e-3281-41e3-83ba-7bda08eb9d9e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:27.063312 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c7228d8e-3281-41e3-83ba-7bda08eb9d9e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:27.199817 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c7228d8e-3281-41e3-83ba-7bda08eb9d9e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:27.208502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c7228d8e-3281-41e3-83ba-7bda08eb9d9e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:27.209994 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c7228d8e-3281-41e3-83ba-7bda08eb9d9e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:27.213560 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c7228d8e-3281-41e3-83ba-7bda08eb9d9e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.160295 May 16 15:23:27.213560 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 465/942] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:27 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:28.230754 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4f973354-e16b-41bc-a8a4-bfb8cae44d44 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:28.231367 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4f973354-e16b-41bc-a8a4-bfb8cae44d44 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:28.237660 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f973354-e16b-41bc-a8a4-bfb8cae44d44 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:28.238131 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f973354-e16b-41bc-a8a4-bfb8cae44d44 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:28.238900 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f973354-e16b-41bc-a8a4-bfb8cae44d44 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:28.239337 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f973354-e16b-41bc-a8a4-bfb8cae44d44 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:28.374490 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4f973354-e16b-41bc-a8a4-bfb8cae44d44 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:28.383085 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4f973354-e16b-41bc-a8a4-bfb8cae44d44 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:28.384572 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4f973354-e16b-41bc-a8a4-bfb8cae44d44 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:28.385775 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4f973354-e16b-41bc-a8a4-bfb8cae44d44 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.159498 May 16 15:23:28.386367 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 478/943] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:28 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:28.923628 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1004727579", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1195768707", "security_groups": [{"name": "tempest-secgroup-smoke-649752004"}], "block_device_mapping_v2": [{"uuid": "4a43b1ce-5cb6-4e64-999c-e823c721f3d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f80dbf35-88c8-44d8-af2b-bea94475a461"}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:29.033317 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] validate_networks() for [('f80dbf35-88c8-44d8-af2b-bea94475a461', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:23:29.404280 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-471c6445-9e60-4670-81a2-ed59238d6e9a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:29.404885 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-471c6445-9e60-4670-81a2-ed59238d6e9a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:29.411749 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-471c6445-9e60-4670-81a2-ed59238d6e9a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.412201 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-471c6445-9e60-4670-81a2-ed59238d6e9a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.412975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-471c6445-9e60-4670-81a2-ed59238d6e9a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.413414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-471c6445-9e60-4670-81a2-ed59238d6e9a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.546150 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-471c6445-9e60-4670-81a2-ed59238d6e9a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:29.554412 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-471c6445-9e60-4670-81a2-ed59238d6e9a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:29.555909 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-471c6445-9e60-4670-81a2-ed59238d6e9a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:29.557087 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-471c6445-9e60-4670-81a2-ed59238d6e9a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.156964 May 16 15:23:29.557647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 479/944] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:29 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:23:29.659985 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:23:29.660405 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:23:29.660869 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:23:29.661269 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:23:29.661702 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:23:29.670671 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.671116 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.671909 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.672337 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.688751 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Getting quotas for project b025f7f102ee46fa92e9bb7445e59daa. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:23:29.692557 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Getting quotas for user b34f24054c204d7cb69ca41099913ca5 and project b025f7f102ee46fa92e9bb7445e59daa. Resources: {'instances', 'cores', 'ram'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:23:29.750802 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:23:29.752890 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a43b1ce-5cb6-4e64-999c-e823c721f3d3',volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:23:30.138399 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-617d9326-99fa-4531-beb9-7b953623becd tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.218631 May 16 15:23:30.144501 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 466/945] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:23:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:23:30.149369 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dea6e117-2713-4be1-83ac-3212ed4a96e1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:30.150130 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dea6e117-2713-4be1-83ac-3212ed4a96e1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:30.205671 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dea6e117-2713-4be1-83ac-3212ed4a96e1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:30.212868 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dea6e117-2713-4be1-83ac-3212ed4a96e1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1095 microversion: 2.1 time: 0.067346 May 16 15:23:30.213594 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 480/946] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:30 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:30.576034 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9ad02bb1-a651-4cf9-8f7a-5124f5fb28bf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:30.576632 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9ad02bb1-a651-4cf9-8f7a-5124f5fb28bf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:30.582600 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ad02bb1-a651-4cf9-8f7a-5124f5fb28bf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:30.583047 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ad02bb1-a651-4cf9-8f7a-5124f5fb28bf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:30.583828 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ad02bb1-a651-4cf9-8f7a-5124f5fb28bf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:30.584254 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9ad02bb1-a651-4cf9-8f7a-5124f5fb28bf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:30.715904 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9ad02bb1-a651-4cf9-8f7a-5124f5fb28bf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:30.724132 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9ad02bb1-a651-4cf9-8f7a-5124f5fb28bf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:30.725552 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9ad02bb1-a651-4cf9-8f7a-5124f5fb28bf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:30.726725 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9ad02bb1-a651-4cf9-8f7a-5124f5fb28bf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.155174 May 16 15:23:30.727275 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 467/947] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:30 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:31.231073 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8eaa8bd7-1923-4c73-be89-8e3204036b95 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:31.231739 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8eaa8bd7-1923-4c73-be89-8e3204036b95 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:31.237846 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8eaa8bd7-1923-4c73-be89-8e3204036b95 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:31.238463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8eaa8bd7-1923-4c73-be89-8e3204036b95 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:31.239277 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8eaa8bd7-1923-4c73-be89-8e3204036b95 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:31.239798 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8eaa8bd7-1923-4c73-be89-8e3204036b95 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:31.306919 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8eaa8bd7-1923-4c73-be89-8e3204036b95 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:31.315130 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8eaa8bd7-1923-4c73-be89-8e3204036b95 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1145 microversion: 2.1 time: 0.088550 May 16 15:23:31.315698 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 481/948] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:31 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:31.744987 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5a99e6b7-bbe6-4703-b051-f6392d3292dd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:31.745702 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5a99e6b7-bbe6-4703-b051-f6392d3292dd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:31.752381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5a99e6b7-bbe6-4703-b051-f6392d3292dd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:31.752827 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5a99e6b7-bbe6-4703-b051-f6392d3292dd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:31.753585 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5a99e6b7-bbe6-4703-b051-f6392d3292dd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:31.754017 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5a99e6b7-bbe6-4703-b051-f6392d3292dd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:31.884448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5a99e6b7-bbe6-4703-b051-f6392d3292dd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:31.893761 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5a99e6b7-bbe6-4703-b051-f6392d3292dd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:31.895324 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5a99e6b7-bbe6-4703-b051-f6392d3292dd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:31.896565 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5a99e6b7-bbe6-4703-b051-f6392d3292dd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.155857 May 16 15:23:31.897132 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 468/949] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:31 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:32.006865 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-bd61212a-7ddf-4677-8d33-c1a57dfde9f9 req-320b5d84-4b2f-44e7-a730-c85ffe8089fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535581-9ba0-49d7-83c8-5b46113c41f2", "name": "network-vif-plugged", "status": "completed", "tag": "87b37162-8505-4153-9400-d7df48f99a54"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:32.015518 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-bd61212a-7ddf-4677-8d33-c1a57dfde9f9 req-320b5d84-4b2f-44e7-a730-c85ffe8089fa service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.016206 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-bd61212a-7ddf-4677-8d33-c1a57dfde9f9 req-320b5d84-4b2f-44e7-a730-c85ffe8089fa service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.027879 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-bd61212a-7ddf-4677-8d33-c1a57dfde9f9 req-320b5d84-4b2f-44e7-a730-c85ffe8089fa service nova] Creating event network-vif-plugged:87b37162-8505-4153-9400-d7df48f99a54 for instance 50535581-9ba0-49d7-83c8-5b46113c41f2 on hv-cinder-79578 May 16 15:23:32.032819 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-bd61212a-7ddf-4677-8d33-c1a57dfde9f9 req-320b5d84-4b2f-44e7-a730-c85ffe8089fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029659 May 16 15:23:32.033404 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 482/950] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:32.331955 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-76b614c3-a123-4d65-b5db-cc27bbb7a496 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:32.332571 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-76b614c3-a123-4d65-b5db-cc27bbb7a496 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:32.338912 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76b614c3-a123-4d65-b5db-cc27bbb7a496 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.339495 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76b614c3-a123-4d65-b5db-cc27bbb7a496 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.340396 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76b614c3-a123-4d65-b5db-cc27bbb7a496 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.340938 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76b614c3-a123-4d65-b5db-cc27bbb7a496 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.403707 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-76b614c3-a123-4d65-b5db-cc27bbb7a496 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:32.409218 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-76b614c3-a123-4d65-b5db-cc27bbb7a496 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1201 microversion: 2.1 time: 0.081183 May 16 15:23:32.410430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 469/951] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:32 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1201 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:32.920865 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-77d83adb-0b64-4869-8ec2-d58a86f9950a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:32.921570 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-77d83adb-0b64-4869-8ec2-d58a86f9950a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:32.929137 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77d83adb-0b64-4869-8ec2-d58a86f9950a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.929593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77d83adb-0b64-4869-8ec2-d58a86f9950a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.930610 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77d83adb-0b64-4869-8ec2-d58a86f9950a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.931050 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77d83adb-0b64-4869-8ec2-d58a86f9950a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:33.079117 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-77d83adb-0b64-4869-8ec2-d58a86f9950a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:33.089268 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-77d83adb-0b64-4869-8ec2-d58a86f9950a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:33.090794 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-77d83adb-0b64-4869-8ec2-d58a86f9950a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:33.091954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-77d83adb-0b64-4869-8ec2-d58a86f9950a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.180484 May 16 15:23:33.092509 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 483/952] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:32 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:33.426378 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ce4be093-ea9a-4d02-af96-9add5a1bf68a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:33.427029 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ce4be093-ea9a-4d02-af96-9add5a1bf68a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:33.433915 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce4be093-ea9a-4d02-af96-9add5a1bf68a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:33.434356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce4be093-ea9a-4d02-af96-9add5a1bf68a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:33.435572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce4be093-ea9a-4d02-af96-9add5a1bf68a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:33.436177 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce4be093-ea9a-4d02-af96-9add5a1bf68a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:33.576325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ce4be093-ea9a-4d02-af96-9add5a1bf68a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:33.585565 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ce4be093-ea9a-4d02-af96-9add5a1bf68a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1278 microversion: 2.1 time: 0.161563 May 16 15:23:33.596307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 470/953] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:33 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:34.111359 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e901e40c-c269-4204-9022-67daf3509934 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:34.120451 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e901e40c-c269-4204-9022-67daf3509934 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:34.123894 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e901e40c-c269-4204-9022-67daf3509934 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:34.124349 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e901e40c-c269-4204-9022-67daf3509934 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:34.131719 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e901e40c-c269-4204-9022-67daf3509934 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:34.132377 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e901e40c-c269-4204-9022-67daf3509934 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:34.311273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e901e40c-c269-4204-9022-67daf3509934 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:34.320067 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e901e40c-c269-4204-9022-67daf3509934 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:34.321597 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e901e40c-c269-4204-9022-67daf3509934 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:34.322908 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e901e40c-c269-4204-9022-67daf3509934 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.215596 May 16 15:23:34.323409 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 484/954] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:34 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:23:34.373565 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-79adfb54-2629-45a8-8dbd-070e2435fee5 req-2228e2aa-975c-40be-a0e4-dfb6c2aea5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8702e35e-9664-40a7-bfb2-2e6ade17bdf8", "tag": "c4063f29-0676-40e0-a84d-78902421d427"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:34.385284 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-79adfb54-2629-45a8-8dbd-070e2435fee5 req-2228e2aa-975c-40be-a0e4-dfb6c2aea5c2 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:34.385817 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-79adfb54-2629-45a8-8dbd-070e2435fee5 req-2228e2aa-975c-40be-a0e4-dfb6c2aea5c2 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:34.399967 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-79adfb54-2629-45a8-8dbd-070e2435fee5 req-2228e2aa-975c-40be-a0e4-dfb6c2aea5c2 service nova] Creating event network-changed:c4063f29-0676-40e0-a84d-78902421d427 for instance 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 on hv-cinder-79578 May 16 15:23:34.405729 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-79adfb54-2629-45a8-8dbd-070e2435fee5 req-2228e2aa-975c-40be-a0e4-dfb6c2aea5c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037878 May 16 15:23:34.407568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 471/955] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:34.603334 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-99be776e-26e2-4793-8cf6-1e2771d60e12 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:34.604678 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-99be776e-26e2-4793-8cf6-1e2771d60e12 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:34.610745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99be776e-26e2-4793-8cf6-1e2771d60e12 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:34.611340 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99be776e-26e2-4793-8cf6-1e2771d60e12 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:34.612114 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99be776e-26e2-4793-8cf6-1e2771d60e12 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:34.612552 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99be776e-26e2-4793-8cf6-1e2771d60e12 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:34.800148 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-99be776e-26e2-4793-8cf6-1e2771d60e12 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:34.807632 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-99be776e-26e2-4793-8cf6-1e2771d60e12 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.208577 May 16 15:23:34.814648 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 485/956] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:34 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:35.342481 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-130e7cd1-7867-43ce-a990-e1b2717a3d89 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:35.343304 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-130e7cd1-7867-43ce-a990-e1b2717a3d89 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:35.349391 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-130e7cd1-7867-43ce-a990-e1b2717a3d89 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:35.349819 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-130e7cd1-7867-43ce-a990-e1b2717a3d89 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:35.350752 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-130e7cd1-7867-43ce-a990-e1b2717a3d89 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:35.351226 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-130e7cd1-7867-43ce-a990-e1b2717a3d89 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:35.496675 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-130e7cd1-7867-43ce-a990-e1b2717a3d89 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:35.505260 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-130e7cd1-7867-43ce-a990-e1b2717a3d89 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:35.506789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-130e7cd1-7867-43ce-a990-e1b2717a3d89 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:35.507977 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-130e7cd1-7867-43ce-a990-e1b2717a3d89 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1807 microversion: 2.20 time: 0.170637 May 16 15:23:35.508536 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 472/957] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:35 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:35.824712 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d73b4769-33ff-45bd-b99f-50ad9421ab07 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:35.825313 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d73b4769-33ff-45bd-b99f-50ad9421ab07 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:35.831762 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d73b4769-33ff-45bd-b99f-50ad9421ab07 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:35.832210 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d73b4769-33ff-45bd-b99f-50ad9421ab07 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:35.832990 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d73b4769-33ff-45bd-b99f-50ad9421ab07 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:35.833421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d73b4769-33ff-45bd-b99f-50ad9421ab07 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:35.968657 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d73b4769-33ff-45bd-b99f-50ad9421ab07 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:35.975966 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d73b4769-33ff-45bd-b99f-50ad9421ab07 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.155114 May 16 15:23:35.976535 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 486/958] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:35 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:36.527530 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f3d24eca-fbbf-4e5a-9aa3-093cf5a7f7e9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:36.528125 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f3d24eca-fbbf-4e5a-9aa3-093cf5a7f7e9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:36.534926 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3d24eca-fbbf-4e5a-9aa3-093cf5a7f7e9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:36.535371 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3d24eca-fbbf-4e5a-9aa3-093cf5a7f7e9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:36.536139 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3d24eca-fbbf-4e5a-9aa3-093cf5a7f7e9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:36.536568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3d24eca-fbbf-4e5a-9aa3-093cf5a7f7e9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:36.663878 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f3d24eca-fbbf-4e5a-9aa3-093cf5a7f7e9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:36.672462 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f3d24eca-fbbf-4e5a-9aa3-093cf5a7f7e9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:36.673949 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f3d24eca-fbbf-4e5a-9aa3-093cf5a7f7e9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:36.675124 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f3d24eca-fbbf-4e5a-9aa3-093cf5a7f7e9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1794 microversion: 2.20 time: 0.152339 May 16 15:23:36.675678 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 473/959] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:23:36 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:36.992970 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2fb2a037-e815-4e23-9a93-33acf53beaab tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:36.993581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2fb2a037-e815-4e23-9a93-33acf53beaab tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:37.000064 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fb2a037-e815-4e23-9a93-33acf53beaab tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.000583 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fb2a037-e815-4e23-9a93-33acf53beaab tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.001363 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fb2a037-e815-4e23-9a93-33acf53beaab tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.001794 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fb2a037-e815-4e23-9a93-33acf53beaab tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.131383 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2fb2a037-e815-4e23-9a93-33acf53beaab tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:37.139448 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2fb2a037-e815-4e23-9a93-33acf53beaab tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.150377 May 16 15:23:37.142863 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 487/960] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:36 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:38.157042 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4377b59b-7403-4e5f-a523-a6c0188964b1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:38.157794 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4377b59b-7403-4e5f-a523-a6c0188964b1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:38.164183 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4377b59b-7403-4e5f-a523-a6c0188964b1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:38.164641 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4377b59b-7403-4e5f-a523-a6c0188964b1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:38.165482 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4377b59b-7403-4e5f-a523-a6c0188964b1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:38.166231 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4377b59b-7403-4e5f-a523-a6c0188964b1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:38.294770 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4377b59b-7403-4e5f-a523-a6c0188964b1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:38.302307 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4377b59b-7403-4e5f-a523-a6c0188964b1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.149167 May 16 15:23:38.302873 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 474/961] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:38 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:39.318720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d78319ff-9d39-43e3-b9dd-e5dbdf6807b2 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:39.319331 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d78319ff-9d39-43e3-b9dd-e5dbdf6807b2 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:39.325776 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d78319ff-9d39-43e3-b9dd-e5dbdf6807b2 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:39.326259 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d78319ff-9d39-43e3-b9dd-e5dbdf6807b2 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:39.327056 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d78319ff-9d39-43e3-b9dd-e5dbdf6807b2 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:39.327490 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d78319ff-9d39-43e3-b9dd-e5dbdf6807b2 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:39.458921 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d78319ff-9d39-43e3-b9dd-e5dbdf6807b2 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:39.466676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d78319ff-9d39-43e3-b9dd-e5dbdf6807b2 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.151876 May 16 15:23:39.467240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 488/962] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:39 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:40.483871 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f8fc5ec3-a07d-4723-afa9-a2ec27cb2fca tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:40.484379 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f8fc5ec3-a07d-4723-afa9-a2ec27cb2fca tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:40.490718 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8fc5ec3-a07d-4723-afa9-a2ec27cb2fca tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:40.491159 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8fc5ec3-a07d-4723-afa9-a2ec27cb2fca tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:40.491916 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8fc5ec3-a07d-4723-afa9-a2ec27cb2fca tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:40.492344 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8fc5ec3-a07d-4723-afa9-a2ec27cb2fca tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:40.623250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f8fc5ec3-a07d-4723-afa9-a2ec27cb2fca tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:40.630903 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f8fc5ec3-a07d-4723-afa9-a2ec27cb2fca tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.150971 May 16 15:23:40.631470 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 475/963] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:40 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:41.647379 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7b266383-3d84-4784-9cfe-9963c9bf79bc tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:41.647988 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7b266383-3d84-4784-9cfe-9963c9bf79bc tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:41.654451 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b266383-3d84-4784-9cfe-9963c9bf79bc tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:41.655003 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b266383-3d84-4784-9cfe-9963c9bf79bc tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:41.655776 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b266383-3d84-4784-9cfe-9963c9bf79bc tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:41.656215 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b266383-3d84-4784-9cfe-9963c9bf79bc tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:41.783016 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7b266383-3d84-4784-9cfe-9963c9bf79bc tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:41.790401 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7b266383-3d84-4784-9cfe-9963c9bf79bc tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.146867 May 16 15:23:41.791464 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 489/964] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:41 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:42.807956 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7f6a276c-2bfb-449a-9e68-0ec40427fbfb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:42.808559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7f6a276c-2bfb-449a-9e68-0ec40427fbfb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:42.814832 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6a276c-2bfb-449a-9e68-0ec40427fbfb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:42.815274 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6a276c-2bfb-449a-9e68-0ec40427fbfb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:42.816028 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6a276c-2bfb-449a-9e68-0ec40427fbfb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:42.816456 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6a276c-2bfb-449a-9e68-0ec40427fbfb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:42.943451 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7f6a276c-2bfb-449a-9e68-0ec40427fbfb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:42.951386 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7f6a276c-2bfb-449a-9e68-0ec40427fbfb tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.147785 May 16 15:23:42.952002 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 476/965] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:42 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:43.968317 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fd5222e2-d902-49bd-8935-b7a7aadc4e2e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:43.968922 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fd5222e2-d902-49bd-8935-b7a7aadc4e2e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:43.981642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd5222e2-d902-49bd-8935-b7a7aadc4e2e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:43.981642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd5222e2-d902-49bd-8935-b7a7aadc4e2e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:43.981642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd5222e2-d902-49bd-8935-b7a7aadc4e2e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:43.981642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd5222e2-d902-49bd-8935-b7a7aadc4e2e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:44.112720 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fd5222e2-d902-49bd-8935-b7a7aadc4e2e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:44.120947 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fd5222e2-d902-49bd-8935-b7a7aadc4e2e tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.156451 May 16 15:23:44.121513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 490/966] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:43 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:45.138113 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-320479ab-c40e-4c95-bfcc-1b428287cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:45.138722 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-320479ab-c40e-4c95-bfcc-1b428287cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:45.145093 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-320479ab-c40e-4c95-bfcc-1b428287cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:45.145543 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-320479ab-c40e-4c95-bfcc-1b428287cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:45.146334 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-320479ab-c40e-4c95-bfcc-1b428287cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:45.146779 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-320479ab-c40e-4c95-bfcc-1b428287cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:45.274674 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-320479ab-c40e-4c95-bfcc-1b428287cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:45.282334 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-320479ab-c40e-4c95-bfcc-1b428287cae8 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.148665 May 16 15:23:45.282907 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 477/967] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:45 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:46.113310 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-55123aac-1a82-4b93-9cac-534b8024cd6f req-6666af2f-7f5b-47df-8831-dbdcbacd78de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8702e35e-9664-40a7-bfb2-2e6ade17bdf8", "name": "network-vif-plugged", "status": "completed", "tag": "c4063f29-0676-40e0-a84d-78902421d427"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:46.121975 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-55123aac-1a82-4b93-9cac-534b8024cd6f req-6666af2f-7f5b-47df-8831-dbdcbacd78de service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:46.122488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-55123aac-1a82-4b93-9cac-534b8024cd6f req-6666af2f-7f5b-47df-8831-dbdcbacd78de service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:46.133229 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-55123aac-1a82-4b93-9cac-534b8024cd6f req-6666af2f-7f5b-47df-8831-dbdcbacd78de service nova] Creating event network-vif-plugged:c4063f29-0676-40e0-a84d-78902421d427 for instance 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 on hv-cinder-79578 May 16 15:23:46.138954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-55123aac-1a82-4b93-9cac-534b8024cd6f req-6666af2f-7f5b-47df-8831-dbdcbacd78de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029313 May 16 15:23:46.139616 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 491/968] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:46.298866 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0a45b94a-9dee-4d52-a034-a125e1ef4de1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:46.299499 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0a45b94a-9dee-4d52-a034-a125e1ef4de1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:46.305761 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a45b94a-9dee-4d52-a034-a125e1ef4de1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:46.306250 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a45b94a-9dee-4d52-a034-a125e1ef4de1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:46.307020 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a45b94a-9dee-4d52-a034-a125e1ef4de1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:46.307453 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a45b94a-9dee-4d52-a034-a125e1ef4de1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:46.439856 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0a45b94a-9dee-4d52-a034-a125e1ef4de1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:46.448543 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0a45b94a-9dee-4d52-a034-a125e1ef4de1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.153523 May 16 15:23:46.449171 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 478/969] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:46 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:47.468455 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-06703ed6-12b9-4f07-baec-21a910589536 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:47.469061 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-06703ed6-12b9-4f07-baec-21a910589536 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:47.475106 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06703ed6-12b9-4f07-baec-21a910589536 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:47.475549 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06703ed6-12b9-4f07-baec-21a910589536 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:47.476300 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06703ed6-12b9-4f07-baec-21a910589536 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:47.476726 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06703ed6-12b9-4f07-baec-21a910589536 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:47.605063 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-06703ed6-12b9-4f07-baec-21a910589536 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:47.612330 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-06703ed6-12b9-4f07-baec-21a910589536 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1266 microversion: 2.1 time: 0.148652 May 16 15:23:47.612905 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 492/970] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:47 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:48.629216 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9eddffc7-5d66-4e73-82cb-79ae9fed4f6a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:48.629862 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9eddffc7-5d66-4e73-82cb-79ae9fed4f6a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:48.636705 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9eddffc7-5d66-4e73-82cb-79ae9fed4f6a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:48.637152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9eddffc7-5d66-4e73-82cb-79ae9fed4f6a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:48.637908 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9eddffc7-5d66-4e73-82cb-79ae9fed4f6a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:48.638363 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9eddffc7-5d66-4e73-82cb-79ae9fed4f6a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:48.767134 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9eddffc7-5d66-4e73-82cb-79ae9fed4f6a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:48.775053 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9eddffc7-5d66-4e73-82cb-79ae9fed4f6a tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1452 microversion: 2.1 time: 0.150044 May 16 15:23:48.775615 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 479/971] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:48 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:48.796196 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-049e1aa6-bed3-4327-b1e2-2e44160a6038 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:48.796857 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-049e1aa6-bed3-4327-b1e2-2e44160a6038 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:48.803407 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-049e1aa6-bed3-4327-b1e2-2e44160a6038 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:48.803853 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-049e1aa6-bed3-4327-b1e2-2e44160a6038 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:48.804635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-049e1aa6-bed3-4327-b1e2-2e44160a6038 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:48.805069 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-049e1aa6-bed3-4327-b1e2-2e44160a6038 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:48.957862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-049e1aa6-bed3-4327-b1e2-2e44160a6038 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:48.965560 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-049e1aa6-bed3-4327-b1e2-2e44160a6038 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1452 microversion: 2.1 time: 0.173239 May 16 15:23:48.966179 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 493/972] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:23:48 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:50.952028 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-5453cc29-f8ba-4648-aa50-b7353400b20c req-cb382d8c-18c0-4b3f-b8e1-ee8c181317a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8702e35e-9664-40a7-bfb2-2e6ade17bdf8", "tag": "c4063f29-0676-40e0-a84d-78902421d427"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:50.960616 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-5453cc29-f8ba-4648-aa50-b7353400b20c req-cb382d8c-18c0-4b3f-b8e1-ee8c181317a4 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:50.961113 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-5453cc29-f8ba-4648-aa50-b7353400b20c req-cb382d8c-18c0-4b3f-b8e1-ee8c181317a4 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:50.972317 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-5453cc29-f8ba-4648-aa50-b7353400b20c req-cb382d8c-18c0-4b3f-b8e1-ee8c181317a4 service nova] Creating event network-changed:c4063f29-0676-40e0-a84d-78902421d427 for instance 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 on hv-cinder-79578 May 16 15:23:50.977876 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-5453cc29-f8ba-4648-aa50-b7353400b20c req-cb382d8c-18c0-4b3f-b8e1-ee8c181317a4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028971 May 16 15:23:50.978936 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 480/973] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:10.339343 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0192385d-276f-44ef-b2db-6664bf8d969d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:10.339886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0192385d-276f-44ef-b2db-6664bf8d969d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:10.345792 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0192385d-276f-44ef-b2db-6664bf8d969d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:10.346271 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0192385d-276f-44ef-b2db-6664bf8d969d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:10.347030 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0192385d-276f-44ef-b2db-6664bf8d969d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:10.347458 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0192385d-276f-44ef-b2db-6664bf8d969d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:10.377091 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0192385d-276f-44ef-b2db-6664bf8d969d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments/3bc53503-f53f-46b5-938d-0d1bbb11b743" status: 200 len: 194 microversion: 2.20 time: 0.042289 May 16 15:24:10.377690 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 494/974] 10.222.0.44 () {60 vars in 1453 bytes} [Mon May 16 15:24:10 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments/3bc53503-f53f-46b5-938d-0d1bbb11b743 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:24:10.439894 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-54045fe2-4630-4534-a8af-db9049321d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:10.440468 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-54045fe2-4630-4534-a8af-db9049321d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:10.447224 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54045fe2-4630-4534-a8af-db9049321d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:10.447834 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54045fe2-4630-4534-a8af-db9049321d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:10.448799 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54045fe2-4630-4534-a8af-db9049321d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:10.449340 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-54045fe2-4630-4534-a8af-db9049321d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:10.528466 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-54045fe2-4630-4534-a8af-db9049321d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lazy-loading 'services' on Instance uuid 50535581-9ba0-49d7-83c8-5b46113c41f2 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:24:10.742666 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-54045fe2-4630-4534-a8af-db9049321d24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "DELETE /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments/3bc53503-f53f-46b5-938d-0d1bbb11b743" status: 202 len: 0 microversion: 2.20 time: 0.307419 May 16 15:24:10.743882 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 481/975] 10.222.0.44 () {60 vars in 1456 bytes} [Mon May 16 15:24:10 2022] DELETE /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments/3bc53503-f53f-46b5-938d-0d1bbb11b743 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:24:10.753815 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e516b114-518a-4957-b688-e960972081b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:10.754782 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e516b114-518a-4957-b688-e960972081b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:10.761030 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e516b114-518a-4957-b688-e960972081b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:10.761486 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e516b114-518a-4957-b688-e960972081b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:10.763192 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e516b114-518a-4957-b688-e960972081b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:10.763192 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e516b114-518a-4957-b688-e960972081b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:10.794139 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e516b114-518a-4957-b688-e960972081b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045772 May 16 15:24:10.794700 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 495/976] 10.222.0.44 () {60 vars in 1342 bytes} [Mon May 16 15:24:10 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:24:11.805891 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2dcf79d2-8ae7-4934-8aa3-c709323a6341 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:11.807009 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2dcf79d2-8ae7-4934-8aa3-c709323a6341 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:11.814138 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2dcf79d2-8ae7-4934-8aa3-c709323a6341 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:11.814600 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2dcf79d2-8ae7-4934-8aa3-c709323a6341 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:11.815523 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2dcf79d2-8ae7-4934-8aa3-c709323a6341 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:11.816036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2dcf79d2-8ae7-4934-8aa3-c709323a6341 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:11.850080 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2dcf79d2-8ae7-4934-8aa3-c709323a6341 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048999 May 16 15:24:11.850866 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 482/977] 10.222.0.44 () {60 vars in 1342 bytes} [Mon May 16 15:24:11 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:24:12.862704 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c53ce8e1-350d-4fb2-9e2e-40fff414c974 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:12.863608 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c53ce8e1-350d-4fb2-9e2e-40fff414c974 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:12.869883 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c53ce8e1-350d-4fb2-9e2e-40fff414c974 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:12.870365 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c53ce8e1-350d-4fb2-9e2e-40fff414c974 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:12.871120 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c53ce8e1-350d-4fb2-9e2e-40fff414c974 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:12.871551 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c53ce8e1-350d-4fb2-9e2e-40fff414c974 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:12.901553 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c53ce8e1-350d-4fb2-9e2e-40fff414c974 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042817 May 16 15:24:12.902132 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 496/978] 10.222.0.44 () {60 vars in 1342 bytes} [Mon May 16 15:24:12 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:12.960269 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8cb58eae-17fc-4aba-b085-42c8ee506c7e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:12.960885 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8cb58eae-17fc-4aba-b085-42c8ee506c7e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:12.967963 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8cb58eae-17fc-4aba-b085-42c8ee506c7e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:12.968413 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8cb58eae-17fc-4aba-b085-42c8ee506c7e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:12.969195 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8cb58eae-17fc-4aba-b085-42c8ee506c7e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:12.969631 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8cb58eae-17fc-4aba-b085-42c8ee506c7e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:12.994802 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8cb58eae-17fc-4aba-b085-42c8ee506c7e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:24:13.269814 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8cb58eae-17fc-4aba-b085-42c8ee506c7e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "DELETE /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 204 len: 0 microversion: 2.20 time: 0.313823 May 16 15:24:13.271020 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 483/979] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 16 15:24:12 2022] DELETE /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 15:24:13.279547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-db14f861-65a2-4449-a561-d5c43748a629 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:13.280213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-db14f861-65a2-4449-a561-d5c43748a629 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:13.286199 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db14f861-65a2-4449-a561-d5c43748a629 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:13.286644 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db14f861-65a2-4449-a561-d5c43748a629 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:13.287403 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db14f861-65a2-4449-a561-d5c43748a629 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:13.287862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db14f861-65a2-4449-a561-d5c43748a629 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:13.433010 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-db14f861-65a2-4449-a561-d5c43748a629 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:13.440833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-db14f861-65a2-4449-a561-d5c43748a629 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:13.442383 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-db14f861-65a2-4449-a561-d5c43748a629 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:13.443581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-db14f861-65a2-4449-a561-d5c43748a629 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.167880 May 16 15:24:13.444141 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 497/980] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:13 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:14.463785 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6c39653f-0cc6-4a3c-81c3-b97f97adcfd8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:14.464477 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6c39653f-0cc6-4a3c-81c3-b97f97adcfd8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:14.470871 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c39653f-0cc6-4a3c-81c3-b97f97adcfd8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:14.471322 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c39653f-0cc6-4a3c-81c3-b97f97adcfd8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:14.472084 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c39653f-0cc6-4a3c-81c3-b97f97adcfd8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:14.472581 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c39653f-0cc6-4a3c-81c3-b97f97adcfd8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:14.604618 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6c39653f-0cc6-4a3c-81c3-b97f97adcfd8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:14.612343 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6c39653f-0cc6-4a3c-81c3-b97f97adcfd8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:14.613849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6c39653f-0cc6-4a3c-81c3-b97f97adcfd8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:14.615032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6c39653f-0cc6-4a3c-81c3-b97f97adcfd8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.156190 May 16 15:24:14.615593 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 484/981] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:14 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:15.635033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-21e8b1d1-fbe8-451c-9c39-7ae386399f28 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:15.637008 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-21e8b1d1-fbe8-451c-9c39-7ae386399f28 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:15.645603 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21e8b1d1-fbe8-451c-9c39-7ae386399f28 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:15.645830 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21e8b1d1-fbe8-451c-9c39-7ae386399f28 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:15.646601 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21e8b1d1-fbe8-451c-9c39-7ae386399f28 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:15.647045 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21e8b1d1-fbe8-451c-9c39-7ae386399f28 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:15.884423 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-21e8b1d1-fbe8-451c-9c39-7ae386399f28 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:15.892568 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-21e8b1d1-fbe8-451c-9c39-7ae386399f28 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:15.894031 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-21e8b1d1-fbe8-451c-9c39-7ae386399f28 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:15.895240 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-21e8b1d1-fbe8-451c-9c39-7ae386399f28 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1722 microversion: 2.20 time: 0.266441 May 16 15:24:15.895804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 498/982] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:15 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:16.382556 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-6f9382ab-c2c6-41a2-b726-ee7e01486e0a req-e38be19e-90d5-4550-b162-5e15eeaafad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535581-9ba0-49d7-83c8-5b46113c41f2", "name": "network-vif-deleted", "tag": "87b37162-8505-4153-9400-d7df48f99a54"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:16.392668 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-6f9382ab-c2c6-41a2-b726-ee7e01486e0a req-e38be19e-90d5-4550-b162-5e15eeaafad3 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:16.393191 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-6f9382ab-c2c6-41a2-b726-ee7e01486e0a req-e38be19e-90d5-4550-b162-5e15eeaafad3 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:16.404246 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-6f9382ab-c2c6-41a2-b726-ee7e01486e0a req-e38be19e-90d5-4550-b162-5e15eeaafad3 service nova] Creating event network-vif-deleted:87b37162-8505-4153-9400-d7df48f99a54 for instance 50535581-9ba0-49d7-83c8-5b46113c41f2 on hv-cinder-79578 May 16 15:24:16.409200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-6f9382ab-c2c6-41a2-b726-ee7e01486e0a req-e38be19e-90d5-4550-b162-5e15eeaafad3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030822 May 16 15:24:16.409895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 485/983] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:16.912908 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:16.913457 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:16.920031 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:16.920706 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:16.921513 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:16.921983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:16.952787 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:16.953230 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:16.953677 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lazy-loading 'fault' on Instance uuid 50535581-9ba0-49d7-83c8-5b46113c41f2 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:24:16.993773 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:17.002484 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:17.003973 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:17.005136 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c14e14db-3317-4ce0-a529-085eb46ee86e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 200 len: 1371 microversion: 2.20 time: 0.096249 May 16 15:24:17.005896 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 499/984] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:16 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:24:18.025020 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-18b754e0-2d8b-4ead-add3-6d239b82f11e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:18.025660 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-18b754e0-2d8b-4ead-add3-6d239b82f11e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:18.032326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18b754e0-2d8b-4ead-add3-6d239b82f11e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:18.036032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18b754e0-2d8b-4ead-add3-6d239b82f11e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:18.036032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18b754e0-2d8b-4ead-add3-6d239b82f11e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:18.036032 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18b754e0-2d8b-4ead-add3-6d239b82f11e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:18.047413 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-18b754e0-2d8b-4ead-add3-6d239b82f11e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] HTTP exception thrown: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-18b754e0-2d8b-4ead-add3-6d239b82f11e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Request method failure captured: May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 HTTP/1.1 May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmvq08AxiGXF5HUglRkHV86jS8ag85NuYNjnwKZGODg4Rsnt9cNhjiLTcfj0x7t00dSn88tFps7Rhdc3-c1UrFiwOE1rmN4ygv92qokmfM0cI-KfztBUPn-X7nCllOSyJ6CSy5lIXzQLJsjLgzmLJD-Gx_Yp5W8RxSgpjoGNi6QXXaI May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: 440329d501de48d19ba51dceaa845197 May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:24:18.049001 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/440329d501de48d19ba51dceaa845197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_440329d501de48d19ba51dceaa845197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 440329d501de48d19ba51dceaa845197 May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: c7788bd93c7649368e3fc926a969c7ed May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:24:18.050762 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '50535581-9ba0-49d7-83c8-5b46113c41f2'} May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:24:18.051772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:24:18.053333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:24:18.054782 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-18b754e0-2d8b-4ead-add3-6d239b82f11e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Returning 404 to user: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:24:18.054782 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-18b754e0-2d8b-4ead-add3-6d239b82f11e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 404 len: 111 microversion: 2.20 time: 0.030182 May 16 15:24:18.054782 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 486/985] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:18 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:24:18.059450 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b19f5617-683a-4785-acba-0edc0512a98a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '.version_select at 0x7fc9a75bf9d0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:18.127202 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b19f5617-683a-4785-acba-0edc0512a98a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765314608" status: 204 len: 0 microversion: 2.20 time: 0.071534 May 16 15:24:18.127773 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 500/986] 10.222.0.44 () {60 vars in 1261 bytes} [Mon May 16 15:24:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765314608 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 15:24:18.919138 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c3ed8134-d970-488c-aaf5-27f039d497b2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Action: 'create', calling method: .version_select at 0x7fc9a6daea60>, body: {"keypair": {"name": "tempest-keypair-2006847946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdGoZeVNW8rkCSsbrd0LuGpB+Lqa3+AFC9XIvR14abebQxFLiPIHx/EocxqkOJcLej5fJ8jqSdSWjcq00DAsGrOn2rnZoEFXRDcZ6J+1qrLWB1uhoqC3oaimVdTqBQVgg=="}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:18.932469 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-c3ed8134-d970-488c-aaf5-27f039d497b2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Getting quotas for project 440329d501de48d19ba51dceaa845197. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:24:18.936809 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-c3ed8134-d970-488c-aaf5-27f039d497b2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Getting quotas for user c7788bd93c7649368e3fc926a969c7ed and project 440329d501de48d19ba51dceaa845197. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:24:19.030365 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c3ed8134-d970-488c-aaf5-27f039d497b2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.115703 May 16 15:24:19.031052 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 487/987] 10.222.0.44 () {62 vars in 1199 bytes} [Mon May 16 15:24:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 15:24:21.240927 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-203844296", "imageRef": "0d1874a3-200c-4499-b772-be0d7920d1ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "998469a5-51c9-48fa-9255-eb909b168691"}], "security_groups": [{"name": "tempest-securitygroup--1064938672"}], "key_name": "tempest-keypair-2006847946", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:21.622283 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] validate_networks() for [('998469a5-51c9-48fa-9255-eb909b168691', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:24:21.978989 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:24:21.979416 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:24:21.979880 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:24:21.980281 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:24:21.981227 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:24:21.989742 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:21.990216 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:21.991015 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:21.991445 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:22.009123 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Getting quotas for project 440329d501de48d19ba51dceaa845197. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:24:22.013013 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Getting quotas for user c7788bd93c7649368e3fc926a969c7ed and project 440329d501de48d19ba51dceaa845197. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:24:22.023768 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:24:22.026032 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d1874a3-200c-4499-b772-be0d7920d1ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:24:22.139353 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-683eff04-1895-412b-ad2e-0c40b15c58af tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.903339 May 16 15:24:22.140087 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 501/988] 10.222.0.44 () {62 vars in 1187 bytes} [Mon May 16 15:24:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 15:24:22.150470 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c8114c78-34a1-40b0-8d3c-d0b3dd62a02e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:22.151077 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c8114c78-34a1-40b0-8d3c-d0b3dd62a02e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:22.204736 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c8114c78-34a1-40b0-8d3c-d0b3dd62a02e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:22.212044 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c8114c78-34a1-40b0-8d3c-d0b3dd62a02e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:22.213553 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c8114c78-34a1-40b0-8d3c-d0b3dd62a02e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:22.214688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c8114c78-34a1-40b0-8d3c-d0b3dd62a02e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1281 microversion: 2.20 time: 0.068721 May 16 15:24:22.216080 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 488/989] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:22 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:23.233940 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-42d162fd-0582-4266-acc8-9a1c1351c0d3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:23.234537 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-42d162fd-0582-4266-acc8-9a1c1351c0d3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:23.240565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42d162fd-0582-4266-acc8-9a1c1351c0d3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:23.241011 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42d162fd-0582-4266-acc8-9a1c1351c0d3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:23.241778 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42d162fd-0582-4266-acc8-9a1c1351c0d3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:23.242244 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42d162fd-0582-4266-acc8-9a1c1351c0d3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:23.325842 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42d162fd-0582-4266-acc8-9a1c1351c0d3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:23.334236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42d162fd-0582-4266-acc8-9a1c1351c0d3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:23.335740 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42d162fd-0582-4266-acc8-9a1c1351c0d3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:23.336845 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-42d162fd-0582-4266-acc8-9a1c1351c0d3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1285 microversion: 2.20 time: 0.108011 May 16 15:24:23.337440 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 502/990] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:23 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:24.354902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-607a95bb-8d62-496e-81d5-d7d1c6443d54 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:24.355511 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-607a95bb-8d62-496e-81d5-d7d1c6443d54 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:24.362423 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-607a95bb-8d62-496e-81d5-d7d1c6443d54 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:24.362880 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-607a95bb-8d62-496e-81d5-d7d1c6443d54 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:24.363656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-607a95bb-8d62-496e-81d5-d7d1c6443d54 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:24.364092 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-607a95bb-8d62-496e-81d5-d7d1c6443d54 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:24.429265 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-607a95bb-8d62-496e-81d5-d7d1c6443d54 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:24.437797 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-607a95bb-8d62-496e-81d5-d7d1c6443d54 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:24.439558 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-607a95bb-8d62-496e-81d5-d7d1c6443d54 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:24.440672 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-607a95bb-8d62-496e-81d5-d7d1c6443d54 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1339 microversion: 2.20 time: 0.089651 May 16 15:24:24.441221 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 489/991] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:24 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1339 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:25.459182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d35aec69-12cb-4b40-b674-f05651c305c4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:25.460073 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d35aec69-12cb-4b40-b674-f05651c305c4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:25.466649 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d35aec69-12cb-4b40-b674-f05651c305c4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:25.467391 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d35aec69-12cb-4b40-b674-f05651c305c4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:25.468250 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d35aec69-12cb-4b40-b674-f05651c305c4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:25.468778 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d35aec69-12cb-4b40-b674-f05651c305c4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:25.663700 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d35aec69-12cb-4b40-b674-f05651c305c4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:25.672042 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d35aec69-12cb-4b40-b674-f05651c305c4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:25.673573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d35aec69-12cb-4b40-b674-f05651c305c4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:25.674707 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d35aec69-12cb-4b40-b674-f05651c305c4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.219778 May 16 15:24:25.678331 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 503/992] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:25 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:25.773939 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-058b71eb-2ddd-4c97-ad76-01ae431cb493 req-6aa8a82d-9a59-4357-b263-8563619130aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7340ea8-184f-46fc-beb8-8b4930ad0084", "tag": "4ca14e95-d4f6-4b13-9f5f-86987c637e51"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:25.785860 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-058b71eb-2ddd-4c97-ad76-01ae431cb493 req-6aa8a82d-9a59-4357-b263-8563619130aa service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:25.788316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-058b71eb-2ddd-4c97-ad76-01ae431cb493 req-6aa8a82d-9a59-4357-b263-8563619130aa service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:25.799150 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-058b71eb-2ddd-4c97-ad76-01ae431cb493 req-6aa8a82d-9a59-4357-b263-8563619130aa service nova] Creating event network-changed:4ca14e95-d4f6-4b13-9f5f-86987c637e51 for instance e7340ea8-184f-46fc-beb8-8b4930ad0084 on hv-cinder-79578 May 16 15:24:25.803876 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-058b71eb-2ddd-4c97-ad76-01ae431cb493 req-6aa8a82d-9a59-4357-b263-8563619130aa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033711 May 16 15:24:25.804467 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 490/993] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:26.692708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d9cf7e4f-0ec8-43b0-8948-9ef5a7be643d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:26.693314 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d9cf7e4f-0ec8-43b0-8948-9ef5a7be643d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:26.700147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9cf7e4f-0ec8-43b0-8948-9ef5a7be643d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:26.700638 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9cf7e4f-0ec8-43b0-8948-9ef5a7be643d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:26.701410 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9cf7e4f-0ec8-43b0-8948-9ef5a7be643d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:26.701843 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9cf7e4f-0ec8-43b0-8948-9ef5a7be643d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:26.831950 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d9cf7e4f-0ec8-43b0-8948-9ef5a7be643d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:26.840245 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d9cf7e4f-0ec8-43b0-8948-9ef5a7be643d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:26.841738 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d9cf7e4f-0ec8-43b0-8948-9ef5a7be643d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:26.842859 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d9cf7e4f-0ec8-43b0-8948-9ef5a7be643d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.154091 May 16 15:24:26.843421 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 504/994] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:26 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:27.861995 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-155d8d4a-5783-4e2d-9f91-d4625daa729b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:27.862716 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-155d8d4a-5783-4e2d-9f91-d4625daa729b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:27.868849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-155d8d4a-5783-4e2d-9f91-d4625daa729b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:27.869298 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-155d8d4a-5783-4e2d-9f91-d4625daa729b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:27.870075 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-155d8d4a-5783-4e2d-9f91-d4625daa729b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:27.870514 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-155d8d4a-5783-4e2d-9f91-d4625daa729b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:27.995175 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-155d8d4a-5783-4e2d-9f91-d4625daa729b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:28.003186 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-155d8d4a-5783-4e2d-9f91-d4625daa729b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:28.004728 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-155d8d4a-5783-4e2d-9f91-d4625daa729b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:28.005832 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-155d8d4a-5783-4e2d-9f91-d4625daa729b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.148615 May 16 15:24:28.006467 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 491/995] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:27 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:29.023926 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-78a1267f-81a6-414f-9fd9-8882462f0158 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:29.024561 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-78a1267f-81a6-414f-9fd9-8882462f0158 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:29.031463 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a1267f-81a6-414f-9fd9-8882462f0158 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:29.031906 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a1267f-81a6-414f-9fd9-8882462f0158 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:29.032657 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a1267f-81a6-414f-9fd9-8882462f0158 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:29.033086 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a1267f-81a6-414f-9fd9-8882462f0158 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:29.159675 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-78a1267f-81a6-414f-9fd9-8882462f0158 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:29.167392 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-78a1267f-81a6-414f-9fd9-8882462f0158 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:29.169498 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-78a1267f-81a6-414f-9fd9-8882462f0158 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:29.170624 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-78a1267f-81a6-414f-9fd9-8882462f0158 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.150582 May 16 15:24:29.171195 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 505/996] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:29 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:30.188297 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-418e98c3-d84e-4e5c-ba52-661f45b79798 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:30.188930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-418e98c3-d84e-4e5c-ba52-661f45b79798 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:30.195339 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-418e98c3-d84e-4e5c-ba52-661f45b79798 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:30.195789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-418e98c3-d84e-4e5c-ba52-661f45b79798 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:30.196555 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-418e98c3-d84e-4e5c-ba52-661f45b79798 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:30.197014 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-418e98c3-d84e-4e5c-ba52-661f45b79798 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:30.323642 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-418e98c3-d84e-4e5c-ba52-661f45b79798 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:30.331462 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-418e98c3-d84e-4e5c-ba52-661f45b79798 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:30.333151 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-418e98c3-d84e-4e5c-ba52-661f45b79798 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:30.334274 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-418e98c3-d84e-4e5c-ba52-661f45b79798 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.150566 May 16 15:24:30.334833 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 492/997] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:30 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:31.352027 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c3fff672-802b-404c-bbf8-ac1237b8b6e2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:31.352564 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c3fff672-802b-404c-bbf8-ac1237b8b6e2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:31.358758 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3fff672-802b-404c-bbf8-ac1237b8b6e2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:31.359198 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3fff672-802b-404c-bbf8-ac1237b8b6e2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:31.360014 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3fff672-802b-404c-bbf8-ac1237b8b6e2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:31.360441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3fff672-802b-404c-bbf8-ac1237b8b6e2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:31.488110 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c3fff672-802b-404c-bbf8-ac1237b8b6e2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:31.496442 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c3fff672-802b-404c-bbf8-ac1237b8b6e2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:31.498429 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c3fff672-802b-404c-bbf8-ac1237b8b6e2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:31.499149 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c3fff672-802b-404c-bbf8-ac1237b8b6e2 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.151271 May 16 15:24:31.499708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 506/998] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:31 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:32.517211 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-82796471-8eac-41b0-9f7f-40e5b4931c58 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:32.517737 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-82796471-8eac-41b0-9f7f-40e5b4931c58 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:32.524160 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82796471-8eac-41b0-9f7f-40e5b4931c58 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:32.524609 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82796471-8eac-41b0-9f7f-40e5b4931c58 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:32.525372 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82796471-8eac-41b0-9f7f-40e5b4931c58 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:32.525804 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82796471-8eac-41b0-9f7f-40e5b4931c58 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:32.651766 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-82796471-8eac-41b0-9f7f-40e5b4931c58 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:32.660014 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-82796471-8eac-41b0-9f7f-40e5b4931c58 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:32.661504 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-82796471-8eac-41b0-9f7f-40e5b4931c58 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:32.662627 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-82796471-8eac-41b0-9f7f-40e5b4931c58 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.149424 May 16 15:24:32.663181 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 493/999] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:32 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:33.680089 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2d69da48-e8db-4ffb-9e88-76b12ab8b81c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:33.680731 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2d69da48-e8db-4ffb-9e88-76b12ab8b81c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:33.687202 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d69da48-e8db-4ffb-9e88-76b12ab8b81c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:33.687650 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d69da48-e8db-4ffb-9e88-76b12ab8b81c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:33.688414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d69da48-e8db-4ffb-9e88-76b12ab8b81c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:33.688849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d69da48-e8db-4ffb-9e88-76b12ab8b81c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:33.816802 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2d69da48-e8db-4ffb-9e88-76b12ab8b81c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:33.824593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2d69da48-e8db-4ffb-9e88-76b12ab8b81c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:33.826117 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2d69da48-e8db-4ffb-9e88-76b12ab8b81c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:33.827223 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2d69da48-e8db-4ffb-9e88-76b12ab8b81c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.151064 May 16 15:24:33.827776 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 507/1000] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:33 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:34.845080 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-774699e9-3f96-4650-ac77-0c5f69fdf6ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:34.845712 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-774699e9-3f96-4650-ac77-0c5f69fdf6ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:34.852008 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-774699e9-3f96-4650-ac77-0c5f69fdf6ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:34.852450 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-774699e9-3f96-4650-ac77-0c5f69fdf6ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:34.853197 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-774699e9-3f96-4650-ac77-0c5f69fdf6ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:34.853624 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-774699e9-3f96-4650-ac77-0c5f69fdf6ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:34.978309 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-774699e9-3f96-4650-ac77-0c5f69fdf6ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:34.986649 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-774699e9-3f96-4650-ac77-0c5f69fdf6ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:34.988139 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-774699e9-3f96-4650-ac77-0c5f69fdf6ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:34.989222 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-774699e9-3f96-4650-ac77-0c5f69fdf6ca tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.147998 May 16 15:24:34.989764 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 494/1001] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:34 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:36.007673 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-590d5404-0dae-4671-b221-7dd63d1db396 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:36.008280 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-590d5404-0dae-4671-b221-7dd63d1db396 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:36.016821 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-590d5404-0dae-4671-b221-7dd63d1db396 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.016821 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-590d5404-0dae-4671-b221-7dd63d1db396 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.016821 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-590d5404-0dae-4671-b221-7dd63d1db396 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.017429 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-590d5404-0dae-4671-b221-7dd63d1db396 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.143453 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-590d5404-0dae-4671-b221-7dd63d1db396 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:36.151160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-590d5404-0dae-4671-b221-7dd63d1db396 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:36.152681 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-590d5404-0dae-4671-b221-7dd63d1db396 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:36.153782 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-590d5404-0dae-4671-b221-7dd63d1db396 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.150015 May 16 15:24:36.154382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 508/1002] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:36 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:37.171278 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-188ce931-9126-4c2c-9dc7-fa0018929b60 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:37.171916 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-188ce931-9126-4c2c-9dc7-fa0018929b60 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:37.178258 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-188ce931-9126-4c2c-9dc7-fa0018929b60 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.178712 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-188ce931-9126-4c2c-9dc7-fa0018929b60 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.179476 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-188ce931-9126-4c2c-9dc7-fa0018929b60 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.179914 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-188ce931-9126-4c2c-9dc7-fa0018929b60 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.310295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-188ce931-9126-4c2c-9dc7-fa0018929b60 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:37.318067 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-188ce931-9126-4c2c-9dc7-fa0018929b60 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:37.319583 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-188ce931-9126-4c2c-9dc7-fa0018929b60 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:37.320872 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-188ce931-9126-4c2c-9dc7-fa0018929b60 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.153291 May 16 15:24:37.329989 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 495/1003] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:37 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:37.411055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-6e4ada6b-811f-47d3-b513-b57aaddc0468 req-d649035c-2586-4a6c-a78c-f5e02ca45314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7340ea8-184f-46fc-beb8-8b4930ad0084", "name": "network-vif-plugged", "status": "completed", "tag": "4ca14e95-d4f6-4b13-9f5f-86987c637e51"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:37.419351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-6e4ada6b-811f-47d3-b513-b57aaddc0468 req-d649035c-2586-4a6c-a78c-f5e02ca45314 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.419785 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-6e4ada6b-811f-47d3-b513-b57aaddc0468 req-d649035c-2586-4a6c-a78c-f5e02ca45314 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.430393 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-6e4ada6b-811f-47d3-b513-b57aaddc0468 req-d649035c-2586-4a6c-a78c-f5e02ca45314 service nova] Creating event network-vif-plugged:4ca14e95-d4f6-4b13-9f5f-86987c637e51 for instance e7340ea8-184f-46fc-beb8-8b4930ad0084 on hv-cinder-79578 May 16 15:24:37.435876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-6e4ada6b-811f-47d3-b513-b57aaddc0468 req-d649035c-2586-4a6c-a78c-f5e02ca45314 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028470 May 16 15:24:37.436503 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 509/1004] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:24:38.339427 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-528940d6-d579-460a-9ea6-49fe401c9d5e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:38.339977 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-528940d6-d579-460a-9ea6-49fe401c9d5e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:38.346973 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-528940d6-d579-460a-9ea6-49fe401c9d5e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:38.347418 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-528940d6-d579-460a-9ea6-49fe401c9d5e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:38.348176 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-528940d6-d579-460a-9ea6-49fe401c9d5e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:38.348609 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-528940d6-d579-460a-9ea6-49fe401c9d5e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:38.478217 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-528940d6-d579-460a-9ea6-49fe401c9d5e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:38.485951 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-528940d6-d579-460a-9ea6-49fe401c9d5e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:38.487511 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-528940d6-d579-460a-9ea6-49fe401c9d5e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:38.488657 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-528940d6-d579-460a-9ea6-49fe401c9d5e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.153284 May 16 15:24:38.489400 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 496/1005] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:38 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:39.507629 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-50ab9c4f-59aa-4d96-aeb9-a4139a73df73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:39.508405 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-50ab9c4f-59aa-4d96-aeb9-a4139a73df73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:39.514650 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50ab9c4f-59aa-4d96-aeb9-a4139a73df73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.515094 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50ab9c4f-59aa-4d96-aeb9-a4139a73df73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:39.515853 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50ab9c4f-59aa-4d96-aeb9-a4139a73df73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.516287 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50ab9c4f-59aa-4d96-aeb9-a4139a73df73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:39.645291 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-50ab9c4f-59aa-4d96-aeb9-a4139a73df73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:39.652956 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-50ab9c4f-59aa-4d96-aeb9-a4139a73df73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:39.655110 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-50ab9c4f-59aa-4d96-aeb9-a4139a73df73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:39.656281 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-50ab9c4f-59aa-4d96-aeb9-a4139a73df73 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1407 microversion: 2.20 time: 0.153454 May 16 15:24:39.656826 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 510/1006] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:39 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:40.674138 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-53bc31d5-26c4-4121-8ada-b6a613934fa7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:40.674741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-53bc31d5-26c4-4121-8ada-b6a613934fa7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:40.680978 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-53bc31d5-26c4-4121-8ada-b6a613934fa7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:40.681420 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-53bc31d5-26c4-4121-8ada-b6a613934fa7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:40.682200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-53bc31d5-26c4-4121-8ada-b6a613934fa7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:40.682633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-53bc31d5-26c4-4121-8ada-b6a613934fa7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:40.813269 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-53bc31d5-26c4-4121-8ada-b6a613934fa7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:40.822275 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-53bc31d5-26c4-4121-8ada-b6a613934fa7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:40.823808 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-53bc31d5-26c4-4121-8ada-b6a613934fa7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:40.824960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-53bc31d5-26c4-4121-8ada-b6a613934fa7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1598 microversion: 2.20 time: 0.155219 May 16 15:24:40.825515 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 497/1007] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:24:40 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:40.850297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c0c9dbbc-7f4a-48b4-96a9-778a7aa744aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:40.850777 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c0c9dbbc-7f4a-48b4-96a9-778a7aa744aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:40.857627 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0c9dbbc-7f4a-48b4-96a9-778a7aa744aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:40.858088 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0c9dbbc-7f4a-48b4-96a9-778a7aa744aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:40.858854 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0c9dbbc-7f4a-48b4-96a9-778a7aa744aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:40.859287 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0c9dbbc-7f4a-48b4-96a9-778a7aa744aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:40.933965 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c0c9dbbc-7f4a-48b4-96a9-778a7aa744aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087617 May 16 15:24:40.934599 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 511/1008] 10.222.0.44 () {60 vars in 1315 bytes} [Mon May 16 15:24:40 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:24:41.929747 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-a8ff732a-edfa-40c8-960e-74ddda346fd8 req-64a52bc3-0c3a-4248-8201-78c393bc0b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7340ea8-184f-46fc-beb8-8b4930ad0084", "tag": "4ca14e95-d4f6-4b13-9f5f-86987c637e51"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:41.937962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a8ff732a-edfa-40c8-960e-74ddda346fd8 req-64a52bc3-0c3a-4248-8201-78c393bc0b6d service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:41.938436 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a8ff732a-edfa-40c8-960e-74ddda346fd8 req-64a52bc3-0c3a-4248-8201-78c393bc0b6d service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:41.948939 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-a8ff732a-edfa-40c8-960e-74ddda346fd8 req-64a52bc3-0c3a-4248-8201-78c393bc0b6d service nova] Creating event network-changed:4ca14e95-d4f6-4b13-9f5f-86987c637e51 for instance e7340ea8-184f-46fc-beb8-8b4930ad0084 on hv-cinder-79578 May 16 15:24:41.953972 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-a8ff732a-edfa-40c8-960e-74ddda346fd8 req-64a52bc3-0c3a-4248-8201-78c393bc0b6d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027798 May 16 15:24:41.954713 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 498/1009] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:58.313370 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-46f75e78-2a48-4f81-8148-dea8b64fe3b2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Action: 'create', calling method: .version_select at 0x7fc9a7ea3550>, body: {"keypair": {"name": "tempest-TestShelveInstance-226025383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFglw6xX7Qnmfta5202vkr3xvbQjSiSY4c9EqDNmJRVkdvxiOy4QlCxV5VB/cVBECbys/AlgQw3RpE8n7DUKtYjW2kk3qBlICdPSqsUBW1avuJnbYf0wBKUecfExKT/FLQ=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:58.327543 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-46f75e78-2a48-4f81-8148-dea8b64fe3b2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Getting quotas for project 0b6bd797b8e04be18b7484855142b067. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:24:58.331342 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-46f75e78-2a48-4f81-8148-dea8b64fe3b2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Getting quotas for user 4109353d2bd843bf9756404990ea6832 and project 0b6bd797b8e04be18b7484855142b067. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:24:58.429514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-46f75e78-2a48-4f81-8148-dea8b64fe3b2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.278318 May 16 15:24:58.430141 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 512/1010] 10.222.0.44 () {60 vars in 1158 bytes} [Mon May 16 15:24:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:25:16.956345 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a7e57de4-edd3-4297-8eb1-a4b08ce18ef6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:16.956939 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a7e57de4-edd3-4297-8eb1-a4b08ce18ef6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:16.963913 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7e57de4-edd3-4297-8eb1-a4b08ce18ef6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:16.964365 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7e57de4-edd3-4297-8eb1-a4b08ce18ef6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:16.965128 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7e57de4-edd3-4297-8eb1-a4b08ce18ef6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:16.965570 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7e57de4-edd3-4297-8eb1-a4b08ce18ef6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:16.987738 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a7e57de4-edd3-4297-8eb1-a4b08ce18ef6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/ips" status: 200 len: 151 microversion: 2.20 time: 0.035716 May 16 15:25:16.988291 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 499/1011] 10.222.0.44 () {60 vars in 1288 bytes} [Mon May 16 15:25:16 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:25:17.349045 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1667254118", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-226025383", "security_groups": [{"name": "tempest-secgroup-smoke-706067128"}], "networks": [{"uuid": "9c7b01dd-4fa5-4d97-aa10-e1ee6467d7bb"}], "block_device_mapping_v2": [{"uuid": "e9ac1951-072d-44bb-bf99-b4ac41b16a94", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:17.460682 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] validate_networks() for [('9c7b01dd-4fa5-4d97-aa10-e1ee6467d7bb', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:25:17.820860 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:25:17.821297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:25:17.821789 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:25:17.822220 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:25:17.822622 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:25:17.831478 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:17.831998 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:17.833602 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:17.834040 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:17.850722 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Getting quotas for project 0b6bd797b8e04be18b7484855142b067. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:25:17.854667 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Getting quotas for user 4109353d2bd843bf9756404990ea6832 and project 0b6bd797b8e04be18b7484855142b067. Resources: {'instances', 'cores', 'ram'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:25:17.909568 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:25:17.911698 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e9ac1951-072d-44bb-bf99-b4ac41b16a94',volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:25:18.320082 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b49d8f03-2e55-452a-a4f1-481432feb4c2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.976938 May 16 15:25:18.320723 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 513/1012] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 16 15:25:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:25:18.330731 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-aecb08d1-41f2-4746-9080-cbbb07ddd9dc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:18.332059 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-aecb08d1-41f2-4746-9080-cbbb07ddd9dc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:18.386319 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-aecb08d1-41f2-4746-9080-cbbb07ddd9dc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:18.393220 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-aecb08d1-41f2-4746-9080-cbbb07ddd9dc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1088 microversion: 2.1 time: 0.066378 May 16 15:25:18.393906 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 500/1013] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:18 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:19.054209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c77e3227-fc35-4e0d-bbb5-43b41260cbe0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:19.054743 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c77e3227-fc35-4e0d-bbb5-43b41260cbe0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:19.061272 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c77e3227-fc35-4e0d-bbb5-43b41260cbe0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:19.061715 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c77e3227-fc35-4e0d-bbb5-43b41260cbe0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:19.062510 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c77e3227-fc35-4e0d-bbb5-43b41260cbe0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:19.062945 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c77e3227-fc35-4e0d-bbb5-43b41260cbe0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:19.085617 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-c77e3227-fc35-4e0d-bbb5-43b41260cbe0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lazy-loading 'flavor' on Instance uuid e7340ea8-184f-46fc-beb8-8b4930ad0084 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:25:19.410301 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5fde47f6-2557-42e3-8a30-fe4041ad43d4 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:19.411412 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5fde47f6-2557-42e3-8a30-fe4041ad43d4 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:19.417540 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5fde47f6-2557-42e3-8a30-fe4041ad43d4 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:19.417986 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5fde47f6-2557-42e3-8a30-fe4041ad43d4 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:19.418789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5fde47f6-2557-42e3-8a30-fe4041ad43d4 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:19.419220 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5fde47f6-2557-42e3-8a30-fe4041ad43d4 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:19.490456 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5fde47f6-2557-42e3-8a30-fe4041ad43d4 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:19.503006 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5fde47f6-2557-42e3-8a30-fe4041ad43d4 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1138 microversion: 2.1 time: 0.096611 May 16 15:25:19.503788 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 501/1014] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:19 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1138 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:19.736273 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c77e3227-fc35-4e0d-bbb5-43b41260cbe0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "POST /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/action" status: 202 len: 0 microversion: 2.20 time: 0.686957 May 16 15:25:19.736901 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 514/1015] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 16 15:25:19 2022] POST /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/action => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 16 15:25:19.744835 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fc8cbf3e-7cad-40e8-a48e-da2f3d07bd0e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:19.745443 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fc8cbf3e-7cad-40e8-a48e-da2f3d07bd0e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:19.751404 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc8cbf3e-7cad-40e8-a48e-da2f3d07bd0e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:19.751850 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc8cbf3e-7cad-40e8-a48e-da2f3d07bd0e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:19.752610 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc8cbf3e-7cad-40e8-a48e-da2f3d07bd0e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:19.753043 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc8cbf3e-7cad-40e8-a48e-da2f3d07bd0e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:19.884400 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fc8cbf3e-7cad-40e8-a48e-da2f3d07bd0e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:19.893057 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fc8cbf3e-7cad-40e8-a48e-da2f3d07bd0e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:19.894650 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fc8cbf3e-7cad-40e8-a48e-da2f3d07bd0e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:19.896364 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fc8cbf3e-7cad-40e8-a48e-da2f3d07bd0e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.155298 May 16 15:25:19.896920 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 502/1016] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:19 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:20.520849 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-abfb33f8-739e-4534-97b0-153b4aec756c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:20.521540 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-abfb33f8-739e-4534-97b0-153b4aec756c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:20.527954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-abfb33f8-739e-4534-97b0-153b4aec756c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:20.528401 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-abfb33f8-739e-4534-97b0-153b4aec756c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:20.529213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-abfb33f8-739e-4534-97b0-153b4aec756c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:20.529648 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-abfb33f8-739e-4534-97b0-153b4aec756c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:20.604904 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-abfb33f8-739e-4534-97b0-153b4aec756c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:20.612582 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-abfb33f8-739e-4534-97b0-153b4aec756c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1194 microversion: 2.1 time: 0.096471 May 16 15:25:20.613163 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 515/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:20 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:20.915155 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-acb40818-1830-4064-b3fe-6cd843822611 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:20.916810 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-acb40818-1830-4064-b3fe-6cd843822611 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:20.922111 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-acb40818-1830-4064-b3fe-6cd843822611 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:20.922571 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-acb40818-1830-4064-b3fe-6cd843822611 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:20.923410 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-acb40818-1830-4064-b3fe-6cd843822611 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:20.923847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-acb40818-1830-4064-b3fe-6cd843822611 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:21.057074 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-acb40818-1830-4064-b3fe-6cd843822611 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:21.064977 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-acb40818-1830-4064-b3fe-6cd843822611 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:21.067407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-acb40818-1830-4064-b3fe-6cd843822611 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:21.068568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-acb40818-1830-4064-b3fe-6cd843822611 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.158127 May 16 15:25:21.069129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 503/1018] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:20 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:21.630509 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-02c555ba-1f9a-4366-8377-6413d57ba216 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:21.631695 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-02c555ba-1f9a-4366-8377-6413d57ba216 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:21.638319 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02c555ba-1f9a-4366-8377-6413d57ba216 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:21.639459 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02c555ba-1f9a-4366-8377-6413d57ba216 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:21.640252 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02c555ba-1f9a-4366-8377-6413d57ba216 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:21.640860 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02c555ba-1f9a-4366-8377-6413d57ba216 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:21.967600 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-02c555ba-1f9a-4366-8377-6413d57ba216 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:21.975945 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-02c555ba-1f9a-4366-8377-6413d57ba216 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1271 microversion: 2.1 time: 0.349283 May 16 15:25:21.976756 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 516/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:21 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1271 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:22.087625 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-120a1094-cdfb-45f3-a3fa-5767376d4d39 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:22.088228 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-120a1094-cdfb-45f3-a3fa-5767376d4d39 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:22.094546 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-120a1094-cdfb-45f3-a3fa-5767376d4d39 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:22.094994 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-120a1094-cdfb-45f3-a3fa-5767376d4d39 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:22.095761 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-120a1094-cdfb-45f3-a3fa-5767376d4d39 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:22.101740 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-120a1094-cdfb-45f3-a3fa-5767376d4d39 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:22.224892 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-120a1094-cdfb-45f3-a3fa-5767376d4d39 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:22.232950 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-120a1094-cdfb-45f3-a3fa-5767376d4d39 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:22.234499 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-120a1094-cdfb-45f3-a3fa-5767376d4d39 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:22.235649 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-120a1094-cdfb-45f3-a3fa-5767376d4d39 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.152271 May 16 15:25:22.236209 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 504/1020] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:22 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:22.730125 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-c95cc55a-2739-4704-bf4d-b330a68c9f7c req-02e2ff0b-9df3-4ac6-b926-5a9922ea0bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e407782-18cb-44c7-aeb5-95be87554fb8", "tag": "ca81beba-189f-4dcd-84dc-799c4f2b2989"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:22.739603 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c95cc55a-2739-4704-bf4d-b330a68c9f7c req-02e2ff0b-9df3-4ac6-b926-5a9922ea0bbe service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:22.740039 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c95cc55a-2739-4704-bf4d-b330a68c9f7c req-02e2ff0b-9df3-4ac6-b926-5a9922ea0bbe service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:22.752057 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-c95cc55a-2739-4704-bf4d-b330a68c9f7c req-02e2ff0b-9df3-4ac6-b926-5a9922ea0bbe service nova] Creating event network-changed:ca81beba-189f-4dcd-84dc-799c4f2b2989 for instance 5e407782-18cb-44c7-aeb5-95be87554fb8 on hv-cinder-79578 May 16 15:25:22.757676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-c95cc55a-2739-4704-bf4d-b330a68c9f7c req-02e2ff0b-9df3-4ac6-b926-5a9922ea0bbe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031191 May 16 15:25:22.758388 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 517/1021] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:22.993541 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-015ff9bb-f7fe-43c3-810b-97cb50f026fb tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:22.994256 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-015ff9bb-f7fe-43c3-810b-97cb50f026fb tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:23.000521 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-015ff9bb-f7fe-43c3-810b-97cb50f026fb tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:23.001195 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-015ff9bb-f7fe-43c3-810b-97cb50f026fb tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:23.001982 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-015ff9bb-f7fe-43c3-810b-97cb50f026fb tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:23.002440 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-015ff9bb-f7fe-43c3-810b-97cb50f026fb tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:23.232727 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-015ff9bb-f7fe-43c3-810b-97cb50f026fb tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:23.240735 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-015ff9bb-f7fe-43c3-810b-97cb50f026fb tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.251306 May 16 15:25:23.241303 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 505/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:22 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:23.255114 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-458bf47f-939c-45f6-9f89-90c4bf9d4c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:23.255803 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-458bf47f-939c-45f6-9f89-90c4bf9d4c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:23.261724 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-458bf47f-939c-45f6-9f89-90c4bf9d4c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:23.262205 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-458bf47f-939c-45f6-9f89-90c4bf9d4c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:23.262969 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-458bf47f-939c-45f6-9f89-90c4bf9d4c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:23.263397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-458bf47f-939c-45f6-9f89-90c4bf9d4c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:23.459294 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-458bf47f-939c-45f6-9f89-90c4bf9d4c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:23.467151 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-458bf47f-939c-45f6-9f89-90c4bf9d4c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:23.468636 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-458bf47f-939c-45f6-9f89-90c4bf9d4c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:23.469779 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-458bf47f-939c-45f6-9f89-90c4bf9d4c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.219599 May 16 15:25:23.470403 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 518/1023] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:23 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:24.257053 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a3d097fb-b487-4735-9752-46a53db1a796 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:24.257700 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a3d097fb-b487-4735-9752-46a53db1a796 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:24.264057 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a3d097fb-b487-4735-9752-46a53db1a796 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:24.264502 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a3d097fb-b487-4735-9752-46a53db1a796 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:24.265260 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a3d097fb-b487-4735-9752-46a53db1a796 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:24.265691 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a3d097fb-b487-4735-9752-46a53db1a796 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:24.391315 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a3d097fb-b487-4735-9752-46a53db1a796 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:24.399377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a3d097fb-b487-4735-9752-46a53db1a796 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.146156 May 16 15:25:24.399989 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 506/1024] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:24 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:24.487639 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5dff6eec-bdfa-40ed-8828-a7d994fef26c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:24.488902 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5dff6eec-bdfa-40ed-8828-a7d994fef26c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:24.495195 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5dff6eec-bdfa-40ed-8828-a7d994fef26c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:24.495665 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5dff6eec-bdfa-40ed-8828-a7d994fef26c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:24.496428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5dff6eec-bdfa-40ed-8828-a7d994fef26c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:24.496859 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5dff6eec-bdfa-40ed-8828-a7d994fef26c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:24.621308 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5dff6eec-bdfa-40ed-8828-a7d994fef26c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:24.629108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5dff6eec-bdfa-40ed-8828-a7d994fef26c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:24.630650 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5dff6eec-bdfa-40ed-8828-a7d994fef26c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:24.631804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5dff6eec-bdfa-40ed-8828-a7d994fef26c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.148075 May 16 15:25:24.632372 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 519/1025] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:24 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:25.415910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-91a7511c-5a46-482c-9f5b-dbdf12fd0d59 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:25.416472 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-91a7511c-5a46-482c-9f5b-dbdf12fd0d59 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:25.422897 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-91a7511c-5a46-482c-9f5b-dbdf12fd0d59 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:25.423347 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-91a7511c-5a46-482c-9f5b-dbdf12fd0d59 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:25.424110 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-91a7511c-5a46-482c-9f5b-dbdf12fd0d59 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:25.424541 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-91a7511c-5a46-482c-9f5b-dbdf12fd0d59 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:25.553931 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-91a7511c-5a46-482c-9f5b-dbdf12fd0d59 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:25.561168 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-91a7511c-5a46-482c-9f5b-dbdf12fd0d59 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.149188 May 16 15:25:25.561741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 507/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:25 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:25.649763 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c959303b-1aa4-4dcd-9716-d70a4c7e47a5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:25.650396 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c959303b-1aa4-4dcd-9716-d70a4c7e47a5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:25.656694 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c959303b-1aa4-4dcd-9716-d70a4c7e47a5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:25.657135 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c959303b-1aa4-4dcd-9716-d70a4c7e47a5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:25.657887 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c959303b-1aa4-4dcd-9716-d70a4c7e47a5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:25.658346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c959303b-1aa4-4dcd-9716-d70a4c7e47a5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:25.783234 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c959303b-1aa4-4dcd-9716-d70a4c7e47a5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:25.791514 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c959303b-1aa4-4dcd-9716-d70a4c7e47a5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:25.793013 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c959303b-1aa4-4dcd-9716-d70a4c7e47a5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:25.794236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c959303b-1aa4-4dcd-9716-d70a4c7e47a5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.148345 May 16 15:25:25.794795 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 520/1027] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:25 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:26.577683 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f8605f1d-a464-4f50-9df8-778d012aa678 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:26.578318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f8605f1d-a464-4f50-9df8-778d012aa678 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:26.585460 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8605f1d-a464-4f50-9df8-778d012aa678 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:26.585905 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8605f1d-a464-4f50-9df8-778d012aa678 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:26.586701 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8605f1d-a464-4f50-9df8-778d012aa678 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:26.587129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8605f1d-a464-4f50-9df8-778d012aa678 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:26.714402 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f8605f1d-a464-4f50-9df8-778d012aa678 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:26.721680 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f8605f1d-a464-4f50-9df8-778d012aa678 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.147825 May 16 15:25:26.722280 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 508/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:26 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:26.812515 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-10c6475a-a8ca-4ccd-8f87-0ced74be43d0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:26.813135 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-10c6475a-a8ca-4ccd-8f87-0ced74be43d0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:26.819878 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10c6475a-a8ca-4ccd-8f87-0ced74be43d0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:26.827147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10c6475a-a8ca-4ccd-8f87-0ced74be43d0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:26.827147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10c6475a-a8ca-4ccd-8f87-0ced74be43d0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:26.827147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10c6475a-a8ca-4ccd-8f87-0ced74be43d0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:26.949515 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-10c6475a-a8ca-4ccd-8f87-0ced74be43d0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:26.957115 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-10c6475a-a8ca-4ccd-8f87-0ced74be43d0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:26.958900 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-10c6475a-a8ca-4ccd-8f87-0ced74be43d0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:26.960081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-10c6475a-a8ca-4ccd-8f87-0ced74be43d0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.151471 May 16 15:25:26.960642 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 521/1029] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:26 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:27.739353 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-21c604a5-3161-49d6-a743-8fe53af66934 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:27.739957 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-21c604a5-3161-49d6-a743-8fe53af66934 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:27.746408 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21c604a5-3161-49d6-a743-8fe53af66934 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:27.746858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21c604a5-3161-49d6-a743-8fe53af66934 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:27.747615 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21c604a5-3161-49d6-a743-8fe53af66934 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:27.748051 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21c604a5-3161-49d6-a743-8fe53af66934 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:27.882661 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-21c604a5-3161-49d6-a743-8fe53af66934 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:27.890284 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-21c604a5-3161-49d6-a743-8fe53af66934 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.155139 May 16 15:25:27.891074 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 509/1030] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:27 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:27.977225 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7caf93f3-7dfd-4741-9aff-8f7faad7d829 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:27.977835 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7caf93f3-7dfd-4741-9aff-8f7faad7d829 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:27.984203 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7caf93f3-7dfd-4741-9aff-8f7faad7d829 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:27.984641 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7caf93f3-7dfd-4741-9aff-8f7faad7d829 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:27.985415 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7caf93f3-7dfd-4741-9aff-8f7faad7d829 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:27.985858 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7caf93f3-7dfd-4741-9aff-8f7faad7d829 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:28.432213 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7caf93f3-7dfd-4741-9aff-8f7faad7d829 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:28.440034 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7caf93f3-7dfd-4741-9aff-8f7faad7d829 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:28.441544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7caf93f3-7dfd-4741-9aff-8f7faad7d829 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:28.442737 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7caf93f3-7dfd-4741-9aff-8f7faad7d829 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.469457 May 16 15:25:28.443304 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 522/1031] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:27 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:28.906978 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-547b4d56-a19c-46aa-b8c0-53ec38854753 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:28.907615 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-547b4d56-a19c-46aa-b8c0-53ec38854753 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:28.914006 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-547b4d56-a19c-46aa-b8c0-53ec38854753 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:28.914482 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-547b4d56-a19c-46aa-b8c0-53ec38854753 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:28.915245 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-547b4d56-a19c-46aa-b8c0-53ec38854753 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:28.915874 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-547b4d56-a19c-46aa-b8c0-53ec38854753 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:29.049270 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-547b4d56-a19c-46aa-b8c0-53ec38854753 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:29.054333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-547b4d56-a19c-46aa-b8c0-53ec38854753 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.151224 May 16 15:25:29.055222 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 510/1032] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:28 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:29.063168 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-a08d5263-d0fb-4aa2-9860-c0caabf70354 req-dc569d18-3050-4dc0-91c0-591caf695563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8702e35e-9664-40a7-bfb2-2e6ade17bdf8", "tag": "c4063f29-0676-40e0-a84d-78902421d427"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:29.072117 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-19b5a488-c78d-4757-a612-a12599ce9bac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:29.072664 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-a08d5263-d0fb-4aa2-9860-c0caabf70354 req-dc569d18-3050-4dc0-91c0-591caf695563 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:29.072829 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-19b5a488-c78d-4757-a612-a12599ce9bac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:29.073144 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-a08d5263-d0fb-4aa2-9860-c0caabf70354 req-dc569d18-3050-4dc0-91c0-591caf695563 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:29.079398 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19b5a488-c78d-4757-a612-a12599ce9bac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:29.080121 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19b5a488-c78d-4757-a612-a12599ce9bac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:29.081818 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19b5a488-c78d-4757-a612-a12599ce9bac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:29.082945 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-19b5a488-c78d-4757-a612-a12599ce9bac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:29.090970 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-a08d5263-d0fb-4aa2-9860-c0caabf70354 req-dc569d18-3050-4dc0-91c0-591caf695563 service nova] Creating event network-changed:c4063f29-0676-40e0-a84d-78902421d427 for instance 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 on hv-cinder-79578 May 16 15:25:29.096220 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-a08d5263-d0fb-4aa2-9860-c0caabf70354 req-dc569d18-3050-4dc0-91c0-591caf695563 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036600 May 16 15:25:29.097225 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 523/1033] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:25:29.109637 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-19b5a488-c78d-4757-a612-a12599ce9bac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:25:29.366310 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-19b5a488-c78d-4757-a612-a12599ce9bac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 204 len: 0 microversion: 2.1 time: 0.297656 May 16 15:25:29.366905 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 511/1034] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:25:29 2022] DELETE /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:25:29.376121 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c60ac229-15cf-4d69-a999-ffb72a15a7a1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:29.376945 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c60ac229-15cf-4d69-a999-ffb72a15a7a1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:29.383890 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c60ac229-15cf-4d69-a999-ffb72a15a7a1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:29.388093 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c60ac229-15cf-4d69-a999-ffb72a15a7a1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:29.388093 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c60ac229-15cf-4d69-a999-ffb72a15a7a1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:29.388093 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c60ac229-15cf-4d69-a999-ffb72a15a7a1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:29.461788 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f027ddaa-82b4-4604-8677-3c0031b8a426 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:29.468160 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f027ddaa-82b4-4604-8677-3c0031b8a426 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:29.469030 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f027ddaa-82b4-4604-8677-3c0031b8a426 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:29.469569 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f027ddaa-82b4-4604-8677-3c0031b8a426 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:29.470482 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f027ddaa-82b4-4604-8677-3c0031b8a426 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:29.470993 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f027ddaa-82b4-4604-8677-3c0031b8a426 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:29.522122 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c60ac229-15cf-4d69-a999-ffb72a15a7a1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:29.529958 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c60ac229-15cf-4d69-a999-ffb72a15a7a1 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1576 microversion: 2.1 time: 0.158403 May 16 15:25:29.530765 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 524/1035] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:29 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:29.603557 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f027ddaa-82b4-4604-8677-3c0031b8a426 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:29.611369 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f027ddaa-82b4-4604-8677-3c0031b8a426 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:29.612812 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f027ddaa-82b4-4604-8677-3c0031b8a426 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:29.615353 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f027ddaa-82b4-4604-8677-3c0031b8a426 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.157684 May 16 15:25:29.615353 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 512/1036] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:29 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:30.072139 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3189a59a-81a6-4f4f-9c01-6913c0d56ee9 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:30.072786 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3189a59a-81a6-4f4f-9c01-6913c0d56ee9 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:30.079128 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3189a59a-81a6-4f4f-9c01-6913c0d56ee9 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:30.079573 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3189a59a-81a6-4f4f-9c01-6913c0d56ee9 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:30.080350 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3189a59a-81a6-4f4f-9c01-6913c0d56ee9 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:30.080783 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3189a59a-81a6-4f4f-9c01-6913c0d56ee9 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:30.216106 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3189a59a-81a6-4f4f-9c01-6913c0d56ee9 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:30.224418 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3189a59a-81a6-4f4f-9c01-6913c0d56ee9 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.156288 May 16 15:25:30.224993 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 525/1037] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:30 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:30.547910 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8d9e9290-8f47-425f-b274-8812d05f6fb6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:30.548542 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8d9e9290-8f47-425f-b274-8812d05f6fb6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:30.555080 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d9e9290-8f47-425f-b274-8812d05f6fb6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:30.555535 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d9e9290-8f47-425f-b274-8812d05f6fb6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:30.556311 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d9e9290-8f47-425f-b274-8812d05f6fb6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:30.556750 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d9e9290-8f47-425f-b274-8812d05f6fb6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:30.632838 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a407c7c6-fe83-4472-b8fe-152092c3737d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:30.633435 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a407c7c6-fe83-4472-b8fe-152092c3737d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:30.639505 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a407c7c6-fe83-4472-b8fe-152092c3737d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:30.639944 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a407c7c6-fe83-4472-b8fe-152092c3737d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:30.640708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a407c7c6-fe83-4472-b8fe-152092c3737d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:30.641137 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a407c7c6-fe83-4472-b8fe-152092c3737d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:30.688851 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8d9e9290-8f47-425f-b274-8812d05f6fb6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:30.696958 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8d9e9290-8f47-425f-b274-8812d05f6fb6 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1576 microversion: 2.1 time: 0.152851 May 16 15:25:30.697637 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 513/1038] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:30 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:30.767495 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a407c7c6-fe83-4472-b8fe-152092c3737d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:30.775231 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a407c7c6-fe83-4472-b8fe-152092c3737d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:30.776716 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a407c7c6-fe83-4472-b8fe-152092c3737d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:30.777863 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a407c7c6-fe83-4472-b8fe-152092c3737d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.149398 May 16 15:25:30.778458 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 526/1039] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:30 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:31.241263 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f7372cb2-a908-4c20-98bc-0e56b732cb4e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:31.241875 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f7372cb2-a908-4c20-98bc-0e56b732cb4e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:31.247905 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7372cb2-a908-4c20-98bc-0e56b732cb4e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:31.248348 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7372cb2-a908-4c20-98bc-0e56b732cb4e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:31.249102 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7372cb2-a908-4c20-98bc-0e56b732cb4e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:31.249530 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7372cb2-a908-4c20-98bc-0e56b732cb4e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:31.378637 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f7372cb2-a908-4c20-98bc-0e56b732cb4e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:31.385898 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f7372cb2-a908-4c20-98bc-0e56b732cb4e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.149106 May 16 15:25:31.386487 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 514/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:31 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:31.715326 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-441db5dc-9c53-443b-bf30-5a0353637fc5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:31.715946 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-441db5dc-9c53-443b-bf30-5a0353637fc5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:31.722034 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-441db5dc-9c53-443b-bf30-5a0353637fc5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:31.722515 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-441db5dc-9c53-443b-bf30-5a0353637fc5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:31.723913 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-441db5dc-9c53-443b-bf30-5a0353637fc5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:31.724354 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-441db5dc-9c53-443b-bf30-5a0353637fc5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:31.795923 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b460fd8a-05f5-4ab6-bfbe-7b7b7c3b4a21 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:31.796527 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b460fd8a-05f5-4ab6-bfbe-7b7b7c3b4a21 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:31.802590 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b460fd8a-05f5-4ab6-bfbe-7b7b7c3b4a21 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:31.803039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b460fd8a-05f5-4ab6-bfbe-7b7b7c3b4a21 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:31.803803 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b460fd8a-05f5-4ab6-bfbe-7b7b7c3b4a21 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:31.804233 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b460fd8a-05f5-4ab6-bfbe-7b7b7c3b4a21 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:31.934447 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-441db5dc-9c53-443b-bf30-5a0353637fc5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:31.940690 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b460fd8a-05f5-4ab6-bfbe-7b7b7c3b4a21 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:31.943082 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-441db5dc-9c53-443b-bf30-5a0353637fc5 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1576 microversion: 2.1 time: 0.231543 May 16 15:25:31.943833 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 527/1041] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:31 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:31.949542 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b460fd8a-05f5-4ab6-bfbe-7b7b7c3b4a21 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:31.951185 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b460fd8a-05f5-4ab6-bfbe-7b7b7c3b4a21 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:31.952402 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b460fd8a-05f5-4ab6-bfbe-7b7b7c3b4a21 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.160944 May 16 15:25:31.953169 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 515/1042] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:31 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:32.109197 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-0ec9b65e-6418-44c1-97dc-3b2000b49a93 req-66851eb8-4364-40d5-827f-4e468a5ae16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8702e35e-9664-40a7-bfb2-2e6ade17bdf8", "name": "network-vif-deleted", "tag": "c4063f29-0676-40e0-a84d-78902421d427"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:32.117177 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-0ec9b65e-6418-44c1-97dc-3b2000b49a93 req-66851eb8-4364-40d5-827f-4e468a5ae16c service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.120219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-0ec9b65e-6418-44c1-97dc-3b2000b49a93 req-66851eb8-4364-40d5-827f-4e468a5ae16c service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.128461 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-0ec9b65e-6418-44c1-97dc-3b2000b49a93 req-66851eb8-4364-40d5-827f-4e468a5ae16c service nova] Creating event network-vif-deleted:c4063f29-0676-40e0-a84d-78902421d427 for instance 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 on hv-cinder-79578 May 16 15:25:32.133684 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-0ec9b65e-6418-44c1-97dc-3b2000b49a93 req-66851eb8-4364-40d5-827f-4e468a5ae16c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028167 May 16 15:25:32.134297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 528/1043] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:32.403016 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b8e07626-70ff-48aa-8642-ec63f4dfc3e0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:32.403630 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b8e07626-70ff-48aa-8642-ec63f4dfc3e0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:32.409666 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b8e07626-70ff-48aa-8642-ec63f4dfc3e0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.410143 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b8e07626-70ff-48aa-8642-ec63f4dfc3e0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.410922 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b8e07626-70ff-48aa-8642-ec63f4dfc3e0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.411366 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b8e07626-70ff-48aa-8642-ec63f4dfc3e0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.550411 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b8e07626-70ff-48aa-8642-ec63f4dfc3e0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:32.558613 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b8e07626-70ff-48aa-8642-ec63f4dfc3e0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.159527 May 16 15:25:32.559166 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 516/1044] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:32 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:32.961577 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-890293a1-8a4a-4e6e-a7ec-0145f1d35cac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:32.962249 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-890293a1-8a4a-4e6e-a7ec-0145f1d35cac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:32.968439 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-890293a1-8a4a-4e6e-a7ec-0145f1d35cac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.973526 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-890293a1-8a4a-4e6e-a7ec-0145f1d35cac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.973526 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-890293a1-8a4a-4e6e-a7ec-0145f1d35cac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.973526 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-890293a1-8a4a-4e6e-a7ec-0145f1d35cac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.977288 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e3735767-906b-4991-abe5-05ac5c1edce7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:32.977896 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e3735767-906b-4991-abe5-05ac5c1edce7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:32.984275 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3735767-906b-4991-abe5-05ac5c1edce7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.984725 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3735767-906b-4991-abe5-05ac5c1edce7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.985501 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3735767-906b-4991-abe5-05ac5c1edce7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.985936 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3735767-906b-4991-abe5-05ac5c1edce7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:33.001072 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-890293a1-8a4a-4e6e-a7ec-0145f1d35cac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:33.001527 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-890293a1-8a4a-4e6e-a7ec-0145f1d35cac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:33.001979 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-890293a1-8a4a-4e6e-a7ec-0145f1d35cac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lazy-loading 'fault' on Instance uuid 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:25:33.045104 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-890293a1-8a4a-4e6e-a7ec-0145f1d35cac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:33.053923 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-890293a1-8a4a-4e6e-a7ec-0145f1d35cac tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 200 len: 1231 microversion: 2.1 time: 0.097802 May 16 15:25:33.054882 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 529/1045] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:32 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:33.121057 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e3735767-906b-4991-abe5-05ac5c1edce7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:33.129631 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e3735767-906b-4991-abe5-05ac5c1edce7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:33.131180 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e3735767-906b-4991-abe5-05ac5c1edce7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:33.132431 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e3735767-906b-4991-abe5-05ac5c1edce7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.159626 May 16 15:25:33.132984 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 517/1046] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:32 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:33.574677 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bba4961c-6a39-4792-b214-c998cd3c808b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:33.575196 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bba4961c-6a39-4792-b214-c998cd3c808b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:33.581039 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bba4961c-6a39-4792-b214-c998cd3c808b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:33.581483 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bba4961c-6a39-4792-b214-c998cd3c808b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:33.582938 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bba4961c-6a39-4792-b214-c998cd3c808b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:33.583374 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bba4961c-6a39-4792-b214-c998cd3c808b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:33.711746 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bba4961c-6a39-4792-b214-c998cd3c808b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:33.718914 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bba4961c-6a39-4792-b214-c998cd3c808b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.148135 May 16 15:25:33.719483 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 530/1047] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:33 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:34.071195 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2a94e986-05f0-4ac3-bbf7-e1fdb7544ac4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:34.071800 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2a94e986-05f0-4ac3-bbf7-e1fdb7544ac4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: 8702e35e-9664-40a7-bfb2-2e6ade17bdf8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:34.078199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2a94e986-05f0-4ac3-bbf7-e1fdb7544ac4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:34.078656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2a94e986-05f0-4ac3-bbf7-e1fdb7544ac4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:34.079417 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2a94e986-05f0-4ac3-bbf7-e1fdb7544ac4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:34.079849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2a94e986-05f0-4ac3-bbf7-e1fdb7544ac4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:34.093317 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-2a94e986-05f0-4ac3-bbf7-e1fdb7544ac4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] HTTP exception thrown: Instance 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 could not be found. May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2a94e986-05f0-4ac3-bbf7-e1fdb7544ac4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Request method failure captured: May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 HTTP/1.1 May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmsyvQOKylehpvjj-vLVYoLjPM9s4cjib2oSrqi1AJiNJKPxoHtYPJfE6KBtTh7lDema3Eq6vD6drGrDNPh5Wcav-YK7iuS6h2S2HPEEtO2JEjBsrqSyspScKAbnSaw6dExGAYgDQMDifGFc78o8fj6sEhWzpApOU4Ww7ZxqHIwTkho May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: b025f7f102ee46fa92e9bb7445e59daa May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-TestVolumeBootPattern-717549113 May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:25:34.094975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-TestVolumeBootPattern-717549113 May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: b025f7f102ee46fa92e9bb7445e59daa May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-TestVolumeBootPattern-717549113 May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-TestVolumeBootPattern-717549113-project May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: b34f24054c204d7cb69ca41099913ca5 May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-TestVolumeBootPattern-717549113-project May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 could not be found. May 16 15:25:34.096688 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '8702e35e-9664-40a7-bfb2-2e6ade17bdf8'} May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 could not be found. May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:25:34.098152 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 could not be found. May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 could not be found. May 16 15:25:34.099847 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:25:34.101318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2a94e986-05f0-4ac3-bbf7-e1fdb7544ac4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Returning 404 to user: Instance 8702e35e-9664-40a7-bfb2-2e6ade17bdf8 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:25:34.101318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2a94e986-05f0-4ac3-bbf7-e1fdb7544ac4 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8" status: 404 len: 111 microversion: 2.1 time: 0.029399 May 16 15:25:34.101318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 518/1048] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:34 2022] GET /compute/v2.1/servers/8702e35e-9664-40a7-bfb2-2e6ade17bdf8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:25:34.149887 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b8c5a278-df5b-48ba-93ea-35aa24aa600b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:34.150535 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b8c5a278-df5b-48ba-93ea-35aa24aa600b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:34.156874 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8c5a278-df5b-48ba-93ea-35aa24aa600b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:34.157323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8c5a278-df5b-48ba-93ea-35aa24aa600b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:34.158119 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8c5a278-df5b-48ba-93ea-35aa24aa600b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:34.158553 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8c5a278-df5b-48ba-93ea-35aa24aa600b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:34.284987 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b8c5a278-df5b-48ba-93ea-35aa24aa600b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:34.293554 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b8c5a278-df5b-48ba-93ea-35aa24aa600b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:34.297099 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b8c5a278-df5b-48ba-93ea-35aa24aa600b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:34.297099 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b8c5a278-df5b-48ba-93ea-35aa24aa600b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.150350 May 16 15:25:34.297099 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 531/1049] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:34 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:34.735500 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d2c187cc-5bd7-4847-8af4-8be208fff4db tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:34.736206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d2c187cc-5bd7-4847-8af4-8be208fff4db tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:34.742127 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d2c187cc-5bd7-4847-8af4-8be208fff4db tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:34.742580 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d2c187cc-5bd7-4847-8af4-8be208fff4db tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:34.743345 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d2c187cc-5bd7-4847-8af4-8be208fff4db tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:34.743827 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d2c187cc-5bd7-4847-8af4-8be208fff4db tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:34.779506 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-cad31199-9be3-466d-b82d-9d309fadd5eb req-1433a150-9a5a-420f-b575-fd2ca64dcdff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e407782-18cb-44c7-aeb5-95be87554fb8", "name": "network-vif-plugged", "status": "completed", "tag": "ca81beba-189f-4dcd-84dc-799c4f2b2989"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:34.788297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-cad31199-9be3-466d-b82d-9d309fadd5eb req-1433a150-9a5a-420f-b575-fd2ca64dcdff service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:34.788736 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-cad31199-9be3-466d-b82d-9d309fadd5eb req-1433a150-9a5a-420f-b575-fd2ca64dcdff service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:34.803875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-cad31199-9be3-466d-b82d-9d309fadd5eb req-1433a150-9a5a-420f-b575-fd2ca64dcdff service nova] Creating event network-vif-plugged:ca81beba-189f-4dcd-84dc-799c4f2b2989 for instance 5e407782-18cb-44c7-aeb5-95be87554fb8 on hv-cinder-79578 May 16 15:25:34.809094 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-cad31199-9be3-466d-b82d-9d309fadd5eb req-1433a150-9a5a-420f-b575-fd2ca64dcdff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033068 May 16 15:25:34.809691 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 532/1050] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:25:34.883130 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d2c187cc-5bd7-4847-8af4-8be208fff4db tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:34.890492 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d2c187cc-5bd7-4847-8af4-8be208fff4db tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.158791 May 16 15:25:34.891454 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 519/1051] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:34 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:35.315893 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-631dc4d3-43fa-4744-95fb-4ee860c19830 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:35.317239 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-631dc4d3-43fa-4744-95fb-4ee860c19830 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:35.323705 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-631dc4d3-43fa-4744-95fb-4ee860c19830 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:35.324145 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-631dc4d3-43fa-4744-95fb-4ee860c19830 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:35.324899 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-631dc4d3-43fa-4744-95fb-4ee860c19830 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:35.325328 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-631dc4d3-43fa-4744-95fb-4ee860c19830 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:35.452758 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-631dc4d3-43fa-4744-95fb-4ee860c19830 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:35.460773 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-631dc4d3-43fa-4744-95fb-4ee860c19830 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:35.465368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-631dc4d3-43fa-4744-95fb-4ee860c19830 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:35.465368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-631dc4d3-43fa-4744-95fb-4ee860c19830 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.151780 May 16 15:25:35.465368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 533/1052] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:35 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:35.907953 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-41b896cf-5e15-4137-a5f5-17acfed2fb2c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:35.908557 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-41b896cf-5e15-4137-a5f5-17acfed2fb2c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:35.915545 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-41b896cf-5e15-4137-a5f5-17acfed2fb2c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:35.915984 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-41b896cf-5e15-4137-a5f5-17acfed2fb2c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:35.916739 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-41b896cf-5e15-4137-a5f5-17acfed2fb2c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:35.917169 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-41b896cf-5e15-4137-a5f5-17acfed2fb2c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:36.045774 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-41b896cf-5e15-4137-a5f5-17acfed2fb2c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:36.052999 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-41b896cf-5e15-4137-a5f5-17acfed2fb2c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1259 microversion: 2.1 time: 0.148877 May 16 15:25:36.053579 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 520/1053] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:35 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:36.481195 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b0f4fbcf-24d1-40f1-8144-21d9ac88e451 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:36.481764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b0f4fbcf-24d1-40f1-8144-21d9ac88e451 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:36.488101 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0f4fbcf-24d1-40f1-8144-21d9ac88e451 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:36.488543 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0f4fbcf-24d1-40f1-8144-21d9ac88e451 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:36.489348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0f4fbcf-24d1-40f1-8144-21d9ac88e451 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:36.489777 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0f4fbcf-24d1-40f1-8144-21d9ac88e451 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:36.717789 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b0f4fbcf-24d1-40f1-8144-21d9ac88e451 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:36.725598 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b0f4fbcf-24d1-40f1-8144-21d9ac88e451 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:36.727129 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b0f4fbcf-24d1-40f1-8144-21d9ac88e451 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:36.728297 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b0f4fbcf-24d1-40f1-8144-21d9ac88e451 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1744 microversion: 2.20 time: 0.251444 May 16 15:25:36.728864 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 534/1054] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:36 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1744 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:37.069441 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-77578db3-591b-49de-89ce-b3c7aef13271 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:37.070359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-77578db3-591b-49de-89ce-b3c7aef13271 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:37.078418 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77578db3-591b-49de-89ce-b3c7aef13271 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.078629 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77578db3-591b-49de-89ce-b3c7aef13271 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.079319 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77578db3-591b-49de-89ce-b3c7aef13271 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.079750 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77578db3-591b-49de-89ce-b3c7aef13271 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.214533 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-77578db3-591b-49de-89ce-b3c7aef13271 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:37.221823 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-77578db3-591b-49de-89ce-b3c7aef13271 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1443 microversion: 2.1 time: 0.156922 May 16 15:25:37.222640 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 521/1055] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:37 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:37.238150 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-064aae12-d23a-4100-9505-2f81b40be6d5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:37.239409 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-064aae12-d23a-4100-9505-2f81b40be6d5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:37.245572 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-064aae12-d23a-4100-9505-2f81b40be6d5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.246018 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-064aae12-d23a-4100-9505-2f81b40be6d5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.246804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-064aae12-d23a-4100-9505-2f81b40be6d5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.247236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-064aae12-d23a-4100-9505-2f81b40be6d5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.434631 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-064aae12-d23a-4100-9505-2f81b40be6d5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:37.441953 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-064aae12-d23a-4100-9505-2f81b40be6d5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1443 microversion: 2.1 time: 0.207659 May 16 15:25:37.442546 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 535/1056] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:37 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1443 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:37.524106 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fbaee9fb-ac5f-43b4-99ab-09e3d52536df tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:37.524106 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fbaee9fb-ac5f-43b4-99ab-09e3d52536df tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:37.529584 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-8956c729-4014-4023-87bc-6fbef2535bb1 req-9a8c5b9c-7412-4075-b17e-3b4c273e7c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebbe62e5-c4dc-4203-8f12-3c0802188ea4", "tag": "1d6a2295-76e4-4a50-b3f2-a26938aab948"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:37.534776 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fbaee9fb-ac5f-43b4-99ab-09e3d52536df tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.535942 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fbaee9fb-ac5f-43b4-99ab-09e3d52536df tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.538879 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fbaee9fb-ac5f-43b4-99ab-09e3d52536df tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.539373 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fbaee9fb-ac5f-43b4-99ab-09e3d52536df tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.549529 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-8956c729-4014-4023-87bc-6fbef2535bb1 req-9a8c5b9c-7412-4075-b17e-3b4c273e7c4f service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.549970 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-8956c729-4014-4023-87bc-6fbef2535bb1 req-9a8c5b9c-7412-4075-b17e-3b4c273e7c4f service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.573620 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-8956c729-4014-4023-87bc-6fbef2535bb1 req-9a8c5b9c-7412-4075-b17e-3b4c273e7c4f service nova] Creating event network-changed:1d6a2295-76e4-4a50-b3f2-a26938aab948 for instance ebbe62e5-c4dc-4203-8f12-3c0802188ea4 on hv-cinder-79578 May 16 15:25:37.576643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fbaee9fb-ac5f-43b4-99ab-09e3d52536df tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:25:37.578862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-8956c729-4014-4023-87bc-6fbef2535bb1 req-9a8c5b9c-7412-4075-b17e-3b4c273e7c4f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052822 May 16 15:25:37.579919 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 536/1057] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:37.748155 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-583e5d8f-834f-4a7f-bcf6-d4fbda3e53c9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:37.748966 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-583e5d8f-834f-4a7f-bcf6-d4fbda3e53c9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:37.755525 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-583e5d8f-834f-4a7f-bcf6-d4fbda3e53c9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.756304 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-583e5d8f-834f-4a7f-bcf6-d4fbda3e53c9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.757104 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-583e5d8f-834f-4a7f-bcf6-d4fbda3e53c9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.757537 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-583e5d8f-834f-4a7f-bcf6-d4fbda3e53c9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.971863 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fbaee9fb-ac5f-43b4-99ab-09e3d52536df tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 204 len: 0 microversion: 2.1 time: 0.453541 May 16 15:25:37.976328 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 522/1058] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:25:37 2022] DELETE /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:25:37.982385 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0c225f8a-22ae-4fc9-90e0-05c2e0c9c971 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:37.983949 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0c225f8a-22ae-4fc9-90e0-05c2e0c9c971 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:37.990548 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0c225f8a-22ae-4fc9-90e0-05c2e0c9c971 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.991150 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0c225f8a-22ae-4fc9-90e0-05c2e0c9c971 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.992626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0c225f8a-22ae-4fc9-90e0-05c2e0c9c971 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.992626 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0c225f8a-22ae-4fc9-90e0-05c2e0c9c971 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:38.139808 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0c225f8a-22ae-4fc9-90e0-05c2e0c9c971 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:38.148329 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0c225f8a-22ae-4fc9-90e0-05c2e0c9c971 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1577 microversion: 2.1 time: 0.170505 May 16 15:25:38.148906 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 523/1059] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:37 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:38.212473 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-583e5d8f-834f-4a7f-bcf6-d4fbda3e53c9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:38.220447 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-583e5d8f-834f-4a7f-bcf6-d4fbda3e53c9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:38.222074 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-583e5d8f-834f-4a7f-bcf6-d4fbda3e53c9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:38.223362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-583e5d8f-834f-4a7f-bcf6-d4fbda3e53c9 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1744 microversion: 2.20 time: 0.480022 May 16 15:25:38.224072 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 537/1060] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:37 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1744 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:39.165463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-63937f37-18a6-4ca5-a9a0-38be7a8e0c2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:39.166186 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-63937f37-18a6-4ca5-a9a0-38be7a8e0c2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:39.172577 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63937f37-18a6-4ca5-a9a0-38be7a8e0c2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:39.173112 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63937f37-18a6-4ca5-a9a0-38be7a8e0c2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:39.173952 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63937f37-18a6-4ca5-a9a0-38be7a8e0c2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:39.174486 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63937f37-18a6-4ca5-a9a0-38be7a8e0c2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:39.240768 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2101eba1-79ff-47ee-b0e3-2e40037f2bf4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:39.241369 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2101eba1-79ff-47ee-b0e3-2e40037f2bf4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:39.247603 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2101eba1-79ff-47ee-b0e3-2e40037f2bf4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:39.248045 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2101eba1-79ff-47ee-b0e3-2e40037f2bf4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:39.248810 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2101eba1-79ff-47ee-b0e3-2e40037f2bf4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:39.249238 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2101eba1-79ff-47ee-b0e3-2e40037f2bf4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:39.311444 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-63937f37-18a6-4ca5-a9a0-38be7a8e0c2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:39.319964 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-63937f37-18a6-4ca5-a9a0-38be7a8e0c2f tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1577 microversion: 2.1 time: 0.158452 May 16 15:25:39.320698 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 524/1061] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:39 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:39.503259 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2101eba1-79ff-47ee-b0e3-2e40037f2bf4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:39.511494 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2101eba1-79ff-47ee-b0e3-2e40037f2bf4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:39.512976 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2101eba1-79ff-47ee-b0e3-2e40037f2bf4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:39.514137 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2101eba1-79ff-47ee-b0e3-2e40037f2bf4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1744 microversion: 2.20 time: 0.277379 May 16 15:25:39.514697 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 538/1062] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:39 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1744 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:40.337157 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4f9d72c5-0853-4f92-8b94-d446a231e046 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:40.337775 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4f9d72c5-0853-4f92-8b94-d446a231e046 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:40.344645 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f9d72c5-0853-4f92-8b94-d446a231e046 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:40.348542 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f9d72c5-0853-4f92-8b94-d446a231e046 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:40.348542 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f9d72c5-0853-4f92-8b94-d446a231e046 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:40.348542 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f9d72c5-0853-4f92-8b94-d446a231e046 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:40.368461 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-fadf5b2e-2207-4750-932b-45fb41ce9565 req-e9af65a6-3d2f-4b78-a8c6-bc7f163f106f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e407782-18cb-44c7-aeb5-95be87554fb8", "tag": "ca81beba-189f-4dcd-84dc-799c4f2b2989"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:40.376974 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-fadf5b2e-2207-4750-932b-45fb41ce9565 req-e9af65a6-3d2f-4b78-a8c6-bc7f163f106f service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:40.377620 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-fadf5b2e-2207-4750-932b-45fb41ce9565 req-e9af65a6-3d2f-4b78-a8c6-bc7f163f106f service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:40.391550 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-fadf5b2e-2207-4750-932b-45fb41ce9565 req-e9af65a6-3d2f-4b78-a8c6-bc7f163f106f service nova] Creating event network-changed:ca81beba-189f-4dcd-84dc-799c4f2b2989 for instance 5e407782-18cb-44c7-aeb5-95be87554fb8 on hv-cinder-79578 May 16 15:25:40.397084 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-fadf5b2e-2207-4750-932b-45fb41ce9565 req-e9af65a6-3d2f-4b78-a8c6-bc7f163f106f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034205 May 16 15:25:40.397761 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 539/1063] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:40.493240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4f9d72c5-0853-4f92-8b94-d446a231e046 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:40.505792 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4f9d72c5-0853-4f92-8b94-d446a231e046 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1459 microversion: 2.1 time: 0.168881 May 16 15:25:40.505792 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 525/1064] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:40 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1459 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:40.539114 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8a4b03a2-f467-4f71-95fc-1523bb30e2bd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:40.539814 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8a4b03a2-f467-4f71-95fc-1523bb30e2bd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:40.552507 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8a4b03a2-f467-4f71-95fc-1523bb30e2bd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:40.552971 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8a4b03a2-f467-4f71-95fc-1523bb30e2bd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:40.553755 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8a4b03a2-f467-4f71-95fc-1523bb30e2bd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:40.556427 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8a4b03a2-f467-4f71-95fc-1523bb30e2bd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:40.716955 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-3d62b221-417b-4780-8d82-1dde699c83ff req-cebeb241-ce21-4a95-a22d-a92b166227a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7340ea8-184f-46fc-beb8-8b4930ad0084", "name": "network-vif-plugged", "status": "completed", "tag": "4ca14e95-d4f6-4b13-9f5f-86987c637e51"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:40.739312 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-3d62b221-417b-4780-8d82-1dde699c83ff req-cebeb241-ce21-4a95-a22d-a92b166227a1 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:40.740142 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-3d62b221-417b-4780-8d82-1dde699c83ff req-cebeb241-ce21-4a95-a22d-a92b166227a1 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:40.765474 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-3d62b221-417b-4780-8d82-1dde699c83ff req-cebeb241-ce21-4a95-a22d-a92b166227a1 service nova] Creating event network-vif-plugged:4ca14e95-d4f6-4b13-9f5f-86987c637e51 for instance e7340ea8-184f-46fc-beb8-8b4930ad0084 on hv-cinder-79578 May 16 15:25:40.772024 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-3d62b221-417b-4780-8d82-1dde699c83ff req-cebeb241-ce21-4a95-a22d-a92b166227a1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059762 May 16 15:25:40.772795 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 526/1065] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:41.185291 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8a4b03a2-f467-4f71-95fc-1523bb30e2bd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:41.194920 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8a4b03a2-f467-4f71-95fc-1523bb30e2bd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:41.201726 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8a4b03a2-f467-4f71-95fc-1523bb30e2bd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:41.204067 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8a4b03a2-f467-4f71-95fc-1523bb30e2bd tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1739 microversion: 2.20 time: 0.670597 May 16 15:25:41.207282 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 540/1066] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:40 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1739 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:41.521571 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b2523d18-18ce-414e-bfa2-eb72df9b8788 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:41.524223 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b2523d18-18ce-414e-bfa2-eb72df9b8788 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:41.537276 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b2523d18-18ce-414e-bfa2-eb72df9b8788 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:41.537726 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b2523d18-18ce-414e-bfa2-eb72df9b8788 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:41.538888 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b2523d18-18ce-414e-bfa2-eb72df9b8788 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:41.539494 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b2523d18-18ce-414e-bfa2-eb72df9b8788 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:41.654035 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b2523d18-18ce-414e-bfa2-eb72df9b8788 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f24054c204d7cb69ca41099913ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b025f7f102ee46fa92e9bb7445e59daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:41.669157 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b2523d18-18ce-414e-bfa2-eb72df9b8788 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 200 len: 1226 microversion: 2.1 time: 0.153771 May 16 15:25:41.681656 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 527/1067] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:41 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 1226 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:42.225702 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1d493d49-b6d6-44c0-81a9-1791d3f3a647 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:42.227336 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1d493d49-b6d6-44c0-81a9-1791d3f3a647 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:42.236117 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d493d49-b6d6-44c0-81a9-1791d3f3a647 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:42.236819 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d493d49-b6d6-44c0-81a9-1791d3f3a647 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:42.237753 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d493d49-b6d6-44c0-81a9-1791d3f3a647 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:42.238365 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d493d49-b6d6-44c0-81a9-1791d3f3a647 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:42.392334 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1d493d49-b6d6-44c0-81a9-1791d3f3a647 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:42.401331 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1d493d49-b6d6-44c0-81a9-1791d3f3a647 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:42.403409 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1d493d49-b6d6-44c0-81a9-1791d3f3a647 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:42.415248 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1d493d49-b6d6-44c0-81a9-1791d3f3a647 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1739 microversion: 2.20 time: 0.183886 May 16 15:25:42.416456 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 541/1068] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:42 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:42.422306 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-02db255d-2e08-4e3a-80c6-a3d54379b3a2 req-4b843f8e-b760-44e0-b8dc-3e0c7f9f9b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebbe62e5-c4dc-4203-8f12-3c0802188ea4", "name": "network-vif-deleted", "tag": "1d6a2295-76e4-4a50-b3f2-a26938aab948"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:42.430898 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-02db255d-2e08-4e3a-80c6-a3d54379b3a2 req-4b843f8e-b760-44e0-b8dc-3e0c7f9f9b62 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:42.431406 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-02db255d-2e08-4e3a-80c6-a3d54379b3a2 req-4b843f8e-b760-44e0-b8dc-3e0c7f9f9b62 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:42.443614 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-02db255d-2e08-4e3a-80c6-a3d54379b3a2 req-4b843f8e-b760-44e0-b8dc-3e0c7f9f9b62 service nova] Creating event network-vif-deleted:1d6a2295-76e4-4a50-b3f2-a26938aab948 for instance ebbe62e5-c4dc-4203-8f12-3c0802188ea4 on hv-cinder-79578 May 16 15:25:42.448968 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-02db255d-2e08-4e3a-80c6-a3d54379b3a2 req-4b843f8e-b760-44e0-b8dc-3e0c7f9f9b62 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030510 May 16 15:25:42.449849 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 528/1069] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:42.687384 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-344becb0-e22e-4df9-a987-7e809e1f1bc3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:42.688324 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-344becb0-e22e-4df9-a987-7e809e1f1bc3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: ebbe62e5-c4dc-4203-8f12-3c0802188ea4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:42.694789 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-344becb0-e22e-4df9-a987-7e809e1f1bc3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:42.695368 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-344becb0-e22e-4df9-a987-7e809e1f1bc3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:42.696225 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-344becb0-e22e-4df9-a987-7e809e1f1bc3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:42.696780 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-344becb0-e22e-4df9-a987-7e809e1f1bc3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:42.712193 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-344becb0-e22e-4df9-a987-7e809e1f1bc3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] HTTP exception thrown: Instance ebbe62e5-c4dc-4203-8f12-3c0802188ea4 could not be found. May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-344becb0-e22e-4df9-a987-7e809e1f1bc3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Request method failure captured: May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 HTTP/1.1 May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmsyvQOKylehpvjj-vLVYoLjPM9s4cjib2oSrqi1AJiNJKPxoHtYPJfE6KBtTh7lDema3Eq6vD6drGrDNPh5Wcav-YK7iuS6h2S2HPEEtO2JEjBsrqSyspScKAbnSaw6dExGAYgDQMDifGFc78o8fj6sEhWzpApOU4Ww7ZxqHIwTkho May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: b025f7f102ee46fa92e9bb7445e59daa May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-TestVolumeBootPattern-717549113 May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:25:42.713861 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-TestVolumeBootPattern-717549113 May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: b025f7f102ee46fa92e9bb7445e59daa May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-TestVolumeBootPattern-717549113 May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-TestVolumeBootPattern-717549113-project May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: b34f24054c204d7cb69ca41099913ca5 May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-TestVolumeBootPattern-717549113-project May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance ebbe62e5-c4dc-4203-8f12-3c0802188ea4 could not be found. May 16 15:25:42.716565 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'ebbe62e5-c4dc-4203-8f12-3c0802188ea4'} May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebbe62e5-c4dc-4203-8f12-3c0802188ea4 could not be found. May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:25:42.718414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebbe62e5-c4dc-4203-8f12-3c0802188ea4 could not be found. May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebbe62e5-c4dc-4203-8f12-3c0802188ea4 could not be found. May 16 15:25:42.719983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:25:42.721355 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-344becb0-e22e-4df9-a987-7e809e1f1bc3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Returning 404 to user: Instance ebbe62e5-c4dc-4203-8f12-3c0802188ea4 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:25:42.721355 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-344becb0-e22e-4df9-a987-7e809e1f1bc3 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4" status: 404 len: 111 microversion: 2.1 time: 0.034018 May 16 15:25:42.721355 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 542/1070] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:42 2022] GET /compute/v2.1/servers/ebbe62e5-c4dc-4203-8f12-3c0802188ea4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:25:43.264897 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-76088168-a3cd-494a-bd7e-86a826847c23 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:43.265489 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-76088168-a3cd-494a-bd7e-86a826847c23 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:43.272308 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76088168-a3cd-494a-bd7e-86a826847c23 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:43.272756 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76088168-a3cd-494a-bd7e-86a826847c23 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:43.273772 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76088168-a3cd-494a-bd7e-86a826847c23 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:43.274445 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76088168-a3cd-494a-bd7e-86a826847c23 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:43.289565 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-76088168-a3cd-494a-bd7e-86a826847c23 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] HTTP exception thrown: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-76088168-a3cd-494a-bd7e-86a826847c23 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Request method failure captured: May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: DELETE /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 HTTP/1.1 May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmsyvQOKylehpvjj-vLVYoLjPM9s4cjib2oSrqi1AJiNJKPxoHtYPJfE6KBtTh7lDema3Eq6vD6drGrDNPh5Wcav-YK7iuS6h2S2HPEEtO2JEjBsrqSyspScKAbnSaw6dExGAYgDQMDifGFc78o8fj6sEhWzpApOU4Ww7ZxqHIwTkho May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: b025f7f102ee46fa92e9bb7445e59daa May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-TestVolumeBootPattern-717549113 May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:25:43.291568 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-TestVolumeBootPattern-717549113 May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: b025f7f102ee46fa92e9bb7445e59daa May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-TestVolumeBootPattern-717549113 May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-TestVolumeBootPattern-717549113-project May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: b34f24054c204d7cb69ca41099913ca5 May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-TestVolumeBootPattern-717549113-project May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:25:43.293237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': 'e4fdfaa8-6784-48ce-9d0e-f67d7560a677'} May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:25:43.294200 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:25:43.295711 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:25:43.297862 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-76088168-a3cd-494a-bd7e-86a826847c23 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Returning 404 to user: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:25:43.298923 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-76088168-a3cd-494a-bd7e-86a826847c23 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 404 len: 111 microversion: 2.1 time: 0.039019 May 16 15:25:43.299944 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 529/1071] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:25:43 2022] DELETE /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:25:43.308549 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6fe21c0b-fc2a-45db-ae6a-12e11a6fcf2b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:43.309862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6fe21c0b-fc2a-45db-ae6a-12e11a6fcf2b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] [instance: e4fdfaa8-6784-48ce-9d0e-f67d7560a677] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:43.318306 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fe21c0b-fc2a-45db-ae6a-12e11a6fcf2b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:43.318841 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fe21c0b-fc2a-45db-ae6a-12e11a6fcf2b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:43.319705 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fe21c0b-fc2a-45db-ae6a-12e11a6fcf2b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:43.320219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fe21c0b-fc2a-45db-ae6a-12e11a6fcf2b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:43.336568 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-6fe21c0b-fc2a-45db-ae6a-12e11a6fcf2b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] HTTP exception thrown: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6fe21c0b-fc2a-45db-ae6a-12e11a6fcf2b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Request method failure captured: May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 HTTP/1.1 May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmsyvQOKylehpvjj-vLVYoLjPM9s4cjib2oSrqi1AJiNJKPxoHtYPJfE6KBtTh7lDema3Eq6vD6drGrDNPh5Wcav-YK7iuS6h2S2HPEEtO2JEjBsrqSyspScKAbnSaw6dExGAYgDQMDifGFc78o8fj6sEhWzpApOU4Ww7ZxqHIwTkho May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: b025f7f102ee46fa92e9bb7445e59daa May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-TestVolumeBootPattern-717549113 May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:25:43.338399 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b025f7f102ee46fa92e9bb7445e59daa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-TestVolumeBootPattern-717549113 May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: b025f7f102ee46fa92e9bb7445e59daa May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-TestVolumeBootPattern-717549113 May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-TestVolumeBootPattern-717549113-project May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: b34f24054c204d7cb69ca41099913ca5 May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-TestVolumeBootPattern-717549113-project May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:25:43.340033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'e4fdfaa8-6784-48ce-9d0e-f67d7560a677'} May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:25:43.340867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. May 16 15:25:43.342219 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:25:43.343361 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6fe21c0b-fc2a-45db-ae6a-12e11a6fcf2b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Returning 404 to user: Instance e4fdfaa8-6784-48ce-9d0e-f67d7560a677 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:25:43.343361 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6fe21c0b-fc2a-45db-ae6a-12e11a6fcf2b tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677" status: 404 len: 111 microversion: 2.1 time: 0.035939 May 16 15:25:43.343361 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 543/1072] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:25:43 2022] GET /compute/v2.1/servers/e4fdfaa8-6784-48ce-9d0e-f67d7560a677 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:25:43.423037 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b077bef1-3f19-409b-985f-684a485fe933 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:43.424771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b077bef1-3f19-409b-985f-684a485fe933 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:43.437404 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b077bef1-3f19-409b-985f-684a485fe933 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:43.437935 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b077bef1-3f19-409b-985f-684a485fe933 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:43.441478 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b077bef1-3f19-409b-985f-684a485fe933 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:43.441478 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b077bef1-3f19-409b-985f-684a485fe933 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:43.614087 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b077bef1-3f19-409b-985f-684a485fe933 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:43.618850 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b077bef1-3f19-409b-985f-684a485fe933 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:43.620407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b077bef1-3f19-409b-985f-684a485fe933 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:43.621891 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b077bef1-3f19-409b-985f-684a485fe933 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1739 microversion: 2.20 time: 0.203246 May 16 15:25:43.622503 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 530/1073] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:43 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:44.640912 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-282319a1-9545-4799-8585-4ee289924de7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:44.641518 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-282319a1-9545-4799-8585-4ee289924de7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:44.651252 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-282319a1-9545-4799-8585-4ee289924de7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:44.651911 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-282319a1-9545-4799-8585-4ee289924de7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:44.652488 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-282319a1-9545-4799-8585-4ee289924de7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:44.652922 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-282319a1-9545-4799-8585-4ee289924de7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:44.862334 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-282319a1-9545-4799-8585-4ee289924de7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:44.872755 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-282319a1-9545-4799-8585-4ee289924de7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:44.875321 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-282319a1-9545-4799-8585-4ee289924de7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:44.876676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-282319a1-9545-4799-8585-4ee289924de7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1739 microversion: 2.20 time: 0.239974 May 16 15:25:44.882371 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 544/1074] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:44 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:45.001651 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5d838697-3e63-4180-80bb-5793574cce12 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] Calling method '.version_select at 0x7fc9a6c90280>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:45.133747 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5d838697-3e63-4180-80bb-5793574cce12 tempest-TestVolumeBootPattern-717549113 tempest-TestVolumeBootPattern-717549113-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1195768707" status: 202 len: 0 microversion: 2.1 time: 0.138110 May 16 15:25:45.138862 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 531/1075] 10.222.0.44 () {58 vars in 1262 bytes} [Mon May 16 15:25:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1195768707 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 15:25:45.895015 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-020b7a36-caec-432e-a3d4-7ccfba50f443 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:45.896320 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-020b7a36-caec-432e-a3d4-7ccfba50f443 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:45.906506 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-020b7a36-caec-432e-a3d4-7ccfba50f443 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:45.907358 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-020b7a36-caec-432e-a3d4-7ccfba50f443 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:45.908941 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-020b7a36-caec-432e-a3d4-7ccfba50f443 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:45.909867 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-020b7a36-caec-432e-a3d4-7ccfba50f443 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:46.068643 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-020b7a36-caec-432e-a3d4-7ccfba50f443 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:46.083377 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-020b7a36-caec-432e-a3d4-7ccfba50f443 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:46.087363 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-020b7a36-caec-432e-a3d4-7ccfba50f443 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:46.092247 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-020b7a36-caec-432e-a3d4-7ccfba50f443 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1739 microversion: 2.20 time: 0.201494 May 16 15:25:46.092822 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 545/1076] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:45 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:47.112055 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-eb81de3f-81e6-4dd9-b411-c8720fda98f8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:47.112628 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-eb81de3f-81e6-4dd9-b411-c8720fda98f8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:47.119831 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb81de3f-81e6-4dd9-b411-c8720fda98f8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:47.120381 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb81de3f-81e6-4dd9-b411-c8720fda98f8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:47.121243 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb81de3f-81e6-4dd9-b411-c8720fda98f8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:47.121939 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb81de3f-81e6-4dd9-b411-c8720fda98f8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:47.429517 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-eb81de3f-81e6-4dd9-b411-c8720fda98f8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:47.439052 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-eb81de3f-81e6-4dd9-b411-c8720fda98f8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:47.442555 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-eb81de3f-81e6-4dd9-b411-c8720fda98f8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:47.443071 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-eb81de3f-81e6-4dd9-b411-c8720fda98f8 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1739 microversion: 2.20 time: 0.336099 May 16 15:25:47.449423 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 532/1077] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:47 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:48.461842 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-605aec0e-aa4f-473e-b0d1-f294b7697149 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:48.462563 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-605aec0e-aa4f-473e-b0d1-f294b7697149 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:48.474868 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-605aec0e-aa4f-473e-b0d1-f294b7697149 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:48.475561 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-605aec0e-aa4f-473e-b0d1-f294b7697149 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:48.476585 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-605aec0e-aa4f-473e-b0d1-f294b7697149 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:48.476961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-605aec0e-aa4f-473e-b0d1-f294b7697149 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:48.678035 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-605aec0e-aa4f-473e-b0d1-f294b7697149 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:48.690518 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-605aec0e-aa4f-473e-b0d1-f294b7697149 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:48.692784 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-605aec0e-aa4f-473e-b0d1-f294b7697149 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:48.694307 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-605aec0e-aa4f-473e-b0d1-f294b7697149 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1739 microversion: 2.20 time: 0.237067 May 16 15:25:48.694942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 546/1078] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:48 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:49.714506 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9c5c5c50-f70b-493d-b29d-f6df4fbff6b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:49.715642 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9c5c5c50-f70b-493d-b29d-f6df4fbff6b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:49.723775 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c5c5c50-f70b-493d-b29d-f6df4fbff6b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:49.724520 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c5c5c50-f70b-493d-b29d-f6df4fbff6b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:49.727453 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c5c5c50-f70b-493d-b29d-f6df4fbff6b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:49.728098 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c5c5c50-f70b-493d-b29d-f6df4fbff6b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:49.914296 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9c5c5c50-f70b-493d-b29d-f6df4fbff6b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:49.926919 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9c5c5c50-f70b-493d-b29d-f6df4fbff6b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:49.928767 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9c5c5c50-f70b-493d-b29d-f6df4fbff6b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:49.930330 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9c5c5c50-f70b-493d-b29d-f6df4fbff6b1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1739 microversion: 2.20 time: 0.221190 May 16 15:25:49.941577 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 533/1079] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:49 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:50.949003 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8293ab2a-4215-4d57-a24b-0750435dc5cb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:50.949609 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8293ab2a-4215-4d57-a24b-0750435dc5cb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:50.956678 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8293ab2a-4215-4d57-a24b-0750435dc5cb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:50.961138 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8293ab2a-4215-4d57-a24b-0750435dc5cb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:50.961138 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8293ab2a-4215-4d57-a24b-0750435dc5cb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:50.961138 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8293ab2a-4215-4d57-a24b-0750435dc5cb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:51.153954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8293ab2a-4215-4d57-a24b-0750435dc5cb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:51.164080 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8293ab2a-4215-4d57-a24b-0750435dc5cb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:51.165588 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8293ab2a-4215-4d57-a24b-0750435dc5cb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:51.166796 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8293ab2a-4215-4d57-a24b-0750435dc5cb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1739 microversion: 2.20 time: 0.221678 May 16 15:25:51.167352 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 547/1080] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:50 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:52.184738 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0288dbe1-4424-4699-9c3d-81e239a6847f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:52.186800 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0288dbe1-4424-4699-9c3d-81e239a6847f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:52.193122 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0288dbe1-4424-4699-9c3d-81e239a6847f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:52.193574 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0288dbe1-4424-4699-9c3d-81e239a6847f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:52.194388 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0288dbe1-4424-4699-9c3d-81e239a6847f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:52.194884 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0288dbe1-4424-4699-9c3d-81e239a6847f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:52.390249 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0288dbe1-4424-4699-9c3d-81e239a6847f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:52.407237 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0288dbe1-4424-4699-9c3d-81e239a6847f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:52.408736 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0288dbe1-4424-4699-9c3d-81e239a6847f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:52.409924 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0288dbe1-4424-4699-9c3d-81e239a6847f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1721 microversion: 2.20 time: 0.229130 May 16 15:25:52.410522 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 534/1081] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:52 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:53.428903 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-efacda82-5089-48ad-a2b0-d88073872ba4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:53.429509 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-efacda82-5089-48ad-a2b0-d88073872ba4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:53.435971 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efacda82-5089-48ad-a2b0-d88073872ba4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:53.436414 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efacda82-5089-48ad-a2b0-d88073872ba4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:53.437225 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efacda82-5089-48ad-a2b0-d88073872ba4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:53.437653 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efacda82-5089-48ad-a2b0-d88073872ba4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:53.612351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-efacda82-5089-48ad-a2b0-d88073872ba4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:53.621160 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-efacda82-5089-48ad-a2b0-d88073872ba4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:53.622813 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-efacda82-5089-48ad-a2b0-d88073872ba4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:53.624031 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-efacda82-5089-48ad-a2b0-d88073872ba4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1721 microversion: 2.20 time: 0.199618 May 16 15:25:53.624630 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 548/1082] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:53 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:54.643048 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1c1a8399-4287-4e4f-9702-8a410bffb2d4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:54.643653 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1c1a8399-4287-4e4f-9702-8a410bffb2d4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:54.650692 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c1a8399-4287-4e4f-9702-8a410bffb2d4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:54.651130 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c1a8399-4287-4e4f-9702-8a410bffb2d4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:54.651895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c1a8399-4287-4e4f-9702-8a410bffb2d4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:54.652324 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1c1a8399-4287-4e4f-9702-8a410bffb2d4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:54.780227 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1c1a8399-4287-4e4f-9702-8a410bffb2d4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:54.788441 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1c1a8399-4287-4e4f-9702-8a410bffb2d4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:54.790004 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1c1a8399-4287-4e4f-9702-8a410bffb2d4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:54.791175 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1c1a8399-4287-4e4f-9702-8a410bffb2d4 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1721 microversion: 2.20 time: 0.152023 May 16 15:25:54.791734 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 535/1083] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:54 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:55.810008 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fe250126-04a3-4593-a698-9b0b662738eb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:55.810635 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fe250126-04a3-4593-a698-9b0b662738eb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:55.817486 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe250126-04a3-4593-a698-9b0b662738eb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:55.817926 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe250126-04a3-4593-a698-9b0b662738eb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:55.818703 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe250126-04a3-4593-a698-9b0b662738eb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:55.819161 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe250126-04a3-4593-a698-9b0b662738eb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:55.949293 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fe250126-04a3-4593-a698-9b0b662738eb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:55.957235 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fe250126-04a3-4593-a698-9b0b662738eb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:55.964954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fe250126-04a3-4593-a698-9b0b662738eb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:55.964954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fe250126-04a3-4593-a698-9b0b662738eb tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1724 microversion: 2.20 time: 0.154712 May 16 15:25:55.964954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 549/1084] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:55 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:55.978082 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0960b783-8039-4dc7-a45a-448d0516613a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9be73975-c508-4ade-b561-3154f96ffaeb"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:55.979161 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0960b783-8039-4dc7-a45a-448d0516613a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:55.985520 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0960b783-8039-4dc7-a45a-448d0516613a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:55.987931 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0960b783-8039-4dc7-a45a-448d0516613a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:55.987931 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0960b783-8039-4dc7-a45a-448d0516613a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:55.987931 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0960b783-8039-4dc7-a45a-448d0516613a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:56.891241 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-af10c7dd-b774-487b-a01d-d62e92d9bd70 req-7bb824df-2b25-4771-a31d-9c477efeb04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7340ea8-184f-46fc-beb8-8b4930ad0084", "name": "network-vif-unplugged", "status": "completed", "tag": "4ca14e95-d4f6-4b13-9f5f-86987c637e51"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:56.899634 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-af10c7dd-b774-487b-a01d-d62e92d9bd70 req-7bb824df-2b25-4771-a31d-9c477efeb04a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:56.900066 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-af10c7dd-b774-487b-a01d-d62e92d9bd70 req-7bb824df-2b25-4771-a31d-9c477efeb04a service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:56.911292 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.compute.server_external_events [req-af10c7dd-b774-487b-a01d-d62e92d9bd70 req-7bb824df-2b25-4771-a31d-9c477efeb04a service nova] Unable to find a host for instance e7340ea8-184f-46fc-beb8-8b4930ad0084. Dropping event network-vif-unplugged {{(pid=117649) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 16 15:25:56.912046 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-af10c7dd-b774-487b-a01d-d62e92d9bd70 req-7bb824df-2b25-4771-a31d-9c477efeb04a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.197042 May 16 15:25:56.912617 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 550/1085] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 198 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 16 15:25:56.949653 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0960b783-8039-4dc7-a45a-448d0516613a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "POST /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.975614 May 16 15:25:56.950313 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 536/1086] 10.222.0.44 () {62 vars in 1363 bytes} [Mon May 16 15:25:55 2022] POST /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/os-volume_attachments => generated 188 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:25:57.065330 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-348d4e15-e382-463d-9314-43e514506a29 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:57.065820 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-348d4e15-e382-463d-9314-43e514506a29 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:57.071842 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-348d4e15-e382-463d-9314-43e514506a29 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:57.072282 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-348d4e15-e382-463d-9314-43e514506a29 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:57.077134 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-348d4e15-e382-463d-9314-43e514506a29 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:57.077134 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-348d4e15-e382-463d-9314-43e514506a29 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:57.651522 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-348d4e15-e382-463d-9314-43e514506a29 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/os-volume_attachments/9be73975-c508-4ade-b561-3154f96ffaeb" status: 202 len: 0 microversion: 2.20 time: 0.589951 May 16 15:25:57.652046 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 551/1087] 10.222.0.44 () {60 vars in 1456 bytes} [Mon May 16 15:25:57 2022] DELETE /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/os-volume_attachments/9be73975-c508-4ade-b561-3154f96ffaeb => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:25:57.706911 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-eda305b8-c951-488c-9c34-768326f7d107 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:57.707635 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-eda305b8-c951-488c-9c34-768326f7d107 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:57.717189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eda305b8-c951-488c-9c34-768326f7d107 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:57.717635 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eda305b8-c951-488c-9c34-768326f7d107 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:57.718501 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eda305b8-c951-488c-9c34-768326f7d107 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:57.718937 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eda305b8-c951-488c-9c34-768326f7d107 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:57.946342 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-eda305b8-c951-488c-9c34-768326f7d107 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "POST /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/action" status: 202 len: 0 microversion: 2.20 time: 0.243231 May 16 15:25:57.946867 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 537/1088] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 16 15:25:57 2022] POST /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:25:57.955001 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7a3b82d8-50aa-4e79-adff-07e44cc6b09b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:57.955755 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7a3b82d8-50aa-4e79-adff-07e44cc6b09b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:57.962685 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a3b82d8-50aa-4e79-adff-07e44cc6b09b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:57.963141 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a3b82d8-50aa-4e79-adff-07e44cc6b09b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:57.963916 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a3b82d8-50aa-4e79-adff-07e44cc6b09b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:57.964351 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a3b82d8-50aa-4e79-adff-07e44cc6b09b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:58.095693 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7a3b82d8-50aa-4e79-adff-07e44cc6b09b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:58.103939 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7a3b82d8-50aa-4e79-adff-07e44cc6b09b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:58.105416 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7a3b82d8-50aa-4e79-adff-07e44cc6b09b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:58.106594 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7a3b82d8-50aa-4e79-adff-07e44cc6b09b tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1672 microversion: 2.20 time: 0.155549 May 16 15:25:58.107147 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 552/1089] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:57 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:59.125466 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-928fe9bc-89c2-4d15-9754-ea62a38df6aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:59.126101 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-928fe9bc-89c2-4d15-9754-ea62a38df6aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:59.132647 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-928fe9bc-89c2-4d15-9754-ea62a38df6aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:59.133098 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-928fe9bc-89c2-4d15-9754-ea62a38df6aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:59.133863 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-928fe9bc-89c2-4d15-9754-ea62a38df6aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:59.134325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-928fe9bc-89c2-4d15-9754-ea62a38df6aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:59.265331 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-928fe9bc-89c2-4d15-9754-ea62a38df6aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:59.273118 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-928fe9bc-89c2-4d15-9754-ea62a38df6aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:59.274658 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-928fe9bc-89c2-4d15-9754-ea62a38df6aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:59.275836 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-928fe9bc-89c2-4d15-9754-ea62a38df6aa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1672 microversion: 2.20 time: 0.155002 May 16 15:25:59.276391 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 538/1090] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:25:59 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:00.293728 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8772aafd-016a-4eba-8aac-e5a32b64141c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:00.293728 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8772aafd-016a-4eba-8aac-e5a32b64141c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:00.300013 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8772aafd-016a-4eba-8aac-e5a32b64141c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:00.300459 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8772aafd-016a-4eba-8aac-e5a32b64141c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:00.301226 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8772aafd-016a-4eba-8aac-e5a32b64141c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:00.301690 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8772aafd-016a-4eba-8aac-e5a32b64141c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:00.432055 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8772aafd-016a-4eba-8aac-e5a32b64141c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:00.439866 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8772aafd-016a-4eba-8aac-e5a32b64141c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:00.441354 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8772aafd-016a-4eba-8aac-e5a32b64141c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:00.443005 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8772aafd-016a-4eba-8aac-e5a32b64141c tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.153976 May 16 15:26:00.443557 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 553/1091] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:00 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:01.461539 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f1a6c248-34b8-4e86-b439-b6af26f72315 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:01.470508 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f1a6c248-34b8-4e86-b439-b6af26f72315 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:01.477228 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1a6c248-34b8-4e86-b439-b6af26f72315 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:01.492144 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1a6c248-34b8-4e86-b439-b6af26f72315 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:01.492144 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1a6c248-34b8-4e86-b439-b6af26f72315 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:01.492144 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1a6c248-34b8-4e86-b439-b6af26f72315 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:01.622163 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f1a6c248-34b8-4e86-b439-b6af26f72315 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:01.630613 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f1a6c248-34b8-4e86-b439-b6af26f72315 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:01.632118 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f1a6c248-34b8-4e86-b439-b6af26f72315 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:01.634377 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f1a6c248-34b8-4e86-b439-b6af26f72315 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.176354 May 16 15:26:01.634995 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 539/1092] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:01 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:02.652436 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-11ed45ff-4e81-4776-9716-0e53de101dcf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:02.653036 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-11ed45ff-4e81-4776-9716-0e53de101dcf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:02.658967 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11ed45ff-4e81-4776-9716-0e53de101dcf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:02.659411 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11ed45ff-4e81-4776-9716-0e53de101dcf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:02.660163 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11ed45ff-4e81-4776-9716-0e53de101dcf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:02.660593 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11ed45ff-4e81-4776-9716-0e53de101dcf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:02.805716 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-11ed45ff-4e81-4776-9716-0e53de101dcf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:02.813467 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-11ed45ff-4e81-4776-9716-0e53de101dcf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:02.814989 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-11ed45ff-4e81-4776-9716-0e53de101dcf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:02.816127 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-11ed45ff-4e81-4776-9716-0e53de101dcf tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.167727 May 16 15:26:02.816677 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 554/1093] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:02 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:03.833917 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-01270e91-1101-4683-a692-bfdb0e275ab3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:03.834571 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-01270e91-1101-4683-a692-bfdb0e275ab3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:03.841178 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-01270e91-1101-4683-a692-bfdb0e275ab3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:03.841627 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-01270e91-1101-4683-a692-bfdb0e275ab3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:03.842419 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-01270e91-1101-4683-a692-bfdb0e275ab3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:03.842853 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-01270e91-1101-4683-a692-bfdb0e275ab3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:03.978256 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-01270e91-1101-4683-a692-bfdb0e275ab3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:03.986864 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-01270e91-1101-4683-a692-bfdb0e275ab3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:03.988390 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-01270e91-1101-4683-a692-bfdb0e275ab3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:03.990092 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-01270e91-1101-4683-a692-bfdb0e275ab3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.160052 May 16 15:26:03.990666 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 540/1094] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:03 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:05.008838 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-033218fa-3d30-48c6-8536-4b0470c7f98e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:05.009547 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-033218fa-3d30-48c6-8536-4b0470c7f98e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:05.016047 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-033218fa-3d30-48c6-8536-4b0470c7f98e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:05.016495 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-033218fa-3d30-48c6-8536-4b0470c7f98e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:05.017260 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-033218fa-3d30-48c6-8536-4b0470c7f98e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:05.017692 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-033218fa-3d30-48c6-8536-4b0470c7f98e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:05.154001 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-033218fa-3d30-48c6-8536-4b0470c7f98e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:05.161944 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-033218fa-3d30-48c6-8536-4b0470c7f98e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:05.163539 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-033218fa-3d30-48c6-8536-4b0470c7f98e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:05.164699 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-033218fa-3d30-48c6-8536-4b0470c7f98e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.160340 May 16 15:26:05.165264 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 555/1095] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:05 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:06.183008 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ccc78c9a-eadf-4cd8-8cc7-78928dba39fa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:06.183733 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ccc78c9a-eadf-4cd8-8cc7-78928dba39fa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:06.190406 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ccc78c9a-eadf-4cd8-8cc7-78928dba39fa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:06.191018 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ccc78c9a-eadf-4cd8-8cc7-78928dba39fa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:06.192020 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ccc78c9a-eadf-4cd8-8cc7-78928dba39fa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:06.192460 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ccc78c9a-eadf-4cd8-8cc7-78928dba39fa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:06.338046 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ccc78c9a-eadf-4cd8-8cc7-78928dba39fa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:06.346763 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ccc78c9a-eadf-4cd8-8cc7-78928dba39fa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:06.348559 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ccc78c9a-eadf-4cd8-8cc7-78928dba39fa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:06.349940 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ccc78c9a-eadf-4cd8-8cc7-78928dba39fa tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.171060 May 16 15:26:06.351205 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 541/1096] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:06 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:07.369059 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cdb7bf18-4af2-4bf3-aaa4-10abd262ca20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:07.369683 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cdb7bf18-4af2-4bf3-aaa4-10abd262ca20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:07.376397 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdb7bf18-4af2-4bf3-aaa4-10abd262ca20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:07.376992 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdb7bf18-4af2-4bf3-aaa4-10abd262ca20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:07.377703 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdb7bf18-4af2-4bf3-aaa4-10abd262ca20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:07.378165 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdb7bf18-4af2-4bf3-aaa4-10abd262ca20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:07.519437 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cdb7bf18-4af2-4bf3-aaa4-10abd262ca20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:07.529616 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cdb7bf18-4af2-4bf3-aaa4-10abd262ca20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:07.531479 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cdb7bf18-4af2-4bf3-aaa4-10abd262ca20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:07.532766 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cdb7bf18-4af2-4bf3-aaa4-10abd262ca20 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.168288 May 16 15:26:07.533530 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 556/1097] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:07 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:08.551881 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ac7859e5-8bdf-409b-a82b-77ed203503b7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:08.554164 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ac7859e5-8bdf-409b-a82b-77ed203503b7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:08.560911 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac7859e5-8bdf-409b-a82b-77ed203503b7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:08.561358 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac7859e5-8bdf-409b-a82b-77ed203503b7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:08.562346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac7859e5-8bdf-409b-a82b-77ed203503b7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:08.562615 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac7859e5-8bdf-409b-a82b-77ed203503b7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:08.718716 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ac7859e5-8bdf-409b-a82b-77ed203503b7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:08.727060 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ac7859e5-8bdf-409b-a82b-77ed203503b7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:08.728572 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ac7859e5-8bdf-409b-a82b-77ed203503b7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:08.729723 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ac7859e5-8bdf-409b-a82b-77ed203503b7 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.181955 May 16 15:26:08.730316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 542/1098] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:08 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:09.749876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-958447df-f997-48fd-8ba0-22379315781f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:09.751994 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-958447df-f997-48fd-8ba0-22379315781f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:09.760665 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-958447df-f997-48fd-8ba0-22379315781f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:09.761799 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-958447df-f997-48fd-8ba0-22379315781f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:09.762963 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-958447df-f997-48fd-8ba0-22379315781f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:09.763745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-958447df-f997-48fd-8ba0-22379315781f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:09.912931 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-958447df-f997-48fd-8ba0-22379315781f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:09.921204 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-958447df-f997-48fd-8ba0-22379315781f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:09.922745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-958447df-f997-48fd-8ba0-22379315781f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:09.923891 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-958447df-f997-48fd-8ba0-22379315781f tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.178676 May 16 15:26:09.924444 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 557/1099] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:09 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:10.942629 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-05b7c85d-e02a-4d57-9f76-c62a08faa25d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:10.943745 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-05b7c85d-e02a-4d57-9f76-c62a08faa25d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:10.949973 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-05b7c85d-e02a-4d57-9f76-c62a08faa25d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:10.950447 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-05b7c85d-e02a-4d57-9f76-c62a08faa25d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:10.951199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-05b7c85d-e02a-4d57-9f76-c62a08faa25d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:10.951625 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-05b7c85d-e02a-4d57-9f76-c62a08faa25d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:11.076391 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-05b7c85d-e02a-4d57-9f76-c62a08faa25d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:11.084771 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-05b7c85d-e02a-4d57-9f76-c62a08faa25d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:11.086542 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-05b7c85d-e02a-4d57-9f76-c62a08faa25d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:11.087682 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-05b7c85d-e02a-4d57-9f76-c62a08faa25d tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.148984 May 16 15:26:11.088236 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 543/1100] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:10 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:12.106591 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-860a861e-fd07-4741-b518-12917bfcea48 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:12.107203 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-860a861e-fd07-4741-b518-12917bfcea48 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:12.113469 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-860a861e-fd07-4741-b518-12917bfcea48 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.113937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-860a861e-fd07-4741-b518-12917bfcea48 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.114750 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-860a861e-fd07-4741-b518-12917bfcea48 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.115211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-860a861e-fd07-4741-b518-12917bfcea48 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.244639 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-860a861e-fd07-4741-b518-12917bfcea48 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:12.252345 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-860a861e-fd07-4741-b518-12917bfcea48 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:12.253847 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-860a861e-fd07-4741-b518-12917bfcea48 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:12.255021 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-860a861e-fd07-4741-b518-12917bfcea48 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.152273 May 16 15:26:12.255579 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 558/1101] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:12 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:13.272744 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0e46f8d4-cc67-4342-8169-6620141ec030 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:13.273288 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0e46f8d4-cc67-4342-8169-6620141ec030 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:13.279404 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e46f8d4-cc67-4342-8169-6620141ec030 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:13.279850 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e46f8d4-cc67-4342-8169-6620141ec030 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:13.280604 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e46f8d4-cc67-4342-8169-6620141ec030 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:13.281034 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e46f8d4-cc67-4342-8169-6620141ec030 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:13.407697 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0e46f8d4-cc67-4342-8169-6620141ec030 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:13.416056 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0e46f8d4-cc67-4342-8169-6620141ec030 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:13.417552 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0e46f8d4-cc67-4342-8169-6620141ec030 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:13.418735 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0e46f8d4-cc67-4342-8169-6620141ec030 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.149963 May 16 15:26:13.419320 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 544/1102] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:13 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:14.436791 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-48036846-b61a-4d7b-a710-1cc76c1b80a0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:14.437343 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-48036846-b61a-4d7b-a710-1cc76c1b80a0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:14.444286 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48036846-b61a-4d7b-a710-1cc76c1b80a0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:14.444726 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48036846-b61a-4d7b-a710-1cc76c1b80a0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:14.445482 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48036846-b61a-4d7b-a710-1cc76c1b80a0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:14.445935 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48036846-b61a-4d7b-a710-1cc76c1b80a0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:14.569976 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-48036846-b61a-4d7b-a710-1cc76c1b80a0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:14.577704 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-48036846-b61a-4d7b-a710-1cc76c1b80a0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:14.579217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-48036846-b61a-4d7b-a710-1cc76c1b80a0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:14.580377 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-48036846-b61a-4d7b-a710-1cc76c1b80a0 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.147553 May 16 15:26:14.580903 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 559/1103] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:14 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:14.817096 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-969c6d3c-53a6-4a8d-8b85-ddb970e5f45f req-3b426ecf-8048-47db-a004-fd777adf57ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7340ea8-184f-46fc-beb8-8b4930ad0084", "name": "network-vif-plugged", "status": "completed", "tag": "4ca14e95-d4f6-4b13-9f5f-86987c637e51"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:14.825447 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-969c6d3c-53a6-4a8d-8b85-ddb970e5f45f req-3b426ecf-8048-47db-a004-fd777adf57ec service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:14.825884 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-969c6d3c-53a6-4a8d-8b85-ddb970e5f45f req-3b426ecf-8048-47db-a004-fd777adf57ec service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:14.836620 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-969c6d3c-53a6-4a8d-8b85-ddb970e5f45f req-3b426ecf-8048-47db-a004-fd777adf57ec service nova] Creating event network-vif-plugged:4ca14e95-d4f6-4b13-9f5f-86987c637e51 for instance e7340ea8-184f-46fc-beb8-8b4930ad0084 on hv-cinder-79578 May 16 15:26:14.841724 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-969c6d3c-53a6-4a8d-8b85-ddb970e5f45f req-3b426ecf-8048-47db-a004-fd777adf57ec service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028215 May 16 15:26:14.842323 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 545/1104] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:15.698863 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-565e121b-1317-4cb7-b0e9-56462e32e6ce tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:15.699478 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-565e121b-1317-4cb7-b0e9-56462e32e6ce tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:15.705272 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-565e121b-1317-4cb7-b0e9-56462e32e6ce tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.705718 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-565e121b-1317-4cb7-b0e9-56462e32e6ce tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.706512 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-565e121b-1317-4cb7-b0e9-56462e32e6ce tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.706963 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-565e121b-1317-4cb7-b0e9-56462e32e6ce tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.837961 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-565e121b-1317-4cb7-b0e9-56462e32e6ce tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:15.845910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-565e121b-1317-4cb7-b0e9-56462e32e6ce tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:15.847512 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-565e121b-1317-4cb7-b0e9-56462e32e6ce tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:15.848660 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-565e121b-1317-4cb7-b0e9-56462e32e6ce tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.253982 May 16 15:26:15.849228 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 560/1105] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:15 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:26:16.866909 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-03dc8e5f-8d59-4c25-a1d0-3e367877929e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:16.867620 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-03dc8e5f-8d59-4c25-a1d0-3e367877929e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:16.874045 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03dc8e5f-8d59-4c25-a1d0-3e367877929e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:16.874554 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03dc8e5f-8d59-4c25-a1d0-3e367877929e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:16.875328 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03dc8e5f-8d59-4c25-a1d0-3e367877929e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:16.876239 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03dc8e5f-8d59-4c25-a1d0-3e367877929e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:17.010244 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-03dc8e5f-8d59-4c25-a1d0-3e367877929e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:17.016941 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-03dc8e5f-8d59-4c25-a1d0-3e367877929e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:17.018448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-03dc8e5f-8d59-4c25-a1d0-3e367877929e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:17.019591 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-03dc8e5f-8d59-4c25-a1d0-3e367877929e tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1730 microversion: 2.20 time: 0.156912 May 16 15:26:17.020141 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 546/1106] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:16 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:18.038030 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-79d3137a-9620-4350-b57d-dc9d16b68bee tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:18.038651 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-79d3137a-9620-4350-b57d-dc9d16b68bee tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:18.045176 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79d3137a-9620-4350-b57d-dc9d16b68bee tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:18.045624 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79d3137a-9620-4350-b57d-dc9d16b68bee tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:18.046424 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79d3137a-9620-4350-b57d-dc9d16b68bee tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:18.046860 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79d3137a-9620-4350-b57d-dc9d16b68bee tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:18.171790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-79d3137a-9620-4350-b57d-dc9d16b68bee tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:18.179580 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-79d3137a-9620-4350-b57d-dc9d16b68bee tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:18.181070 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-79d3137a-9620-4350-b57d-dc9d16b68bee tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:18.182237 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-79d3137a-9620-4350-b57d-dc9d16b68bee tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1717 microversion: 2.20 time: 0.148750 May 16 15:26:18.182794 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 561/1107] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:18 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1717 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:49.089432 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2aebe1cb-0271-4f6b-989e-f6565d472758 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:49.096109 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2aebe1cb-0271-4f6b-989e-f6565d472758 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:49.097050 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2aebe1cb-0271-4f6b-989e-f6565d472758 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:49.097494 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2aebe1cb-0271-4f6b-989e-f6565d472758 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:49.098282 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2aebe1cb-0271-4f6b-989e-f6565d472758 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:49.098713 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2aebe1cb-0271-4f6b-989e-f6565d472758 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:49.127179 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2aebe1cb-0271-4f6b-989e-f6565d472758 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042190 May 16 15:26:49.127725 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 547/1108] 10.222.0.44 () {60 vars in 1342 bytes} [Mon May 16 15:26:49 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:49.184046 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5ea72878-227f-4144-b99c-1a64aefc3c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:49.187973 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5ea72878-227f-4144-b99c-1a64aefc3c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:49.190474 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ea72878-227f-4144-b99c-1a64aefc3c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:49.190916 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ea72878-227f-4144-b99c-1a64aefc3c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:49.191667 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ea72878-227f-4144-b99c-1a64aefc3c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:49.192096 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ea72878-227f-4144-b99c-1a64aefc3c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:49.216965 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5ea72878-227f-4144-b99c-1a64aefc3c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:26:49.505490 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5ea72878-227f-4144-b99c-1a64aefc3c24 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 204 len: 0 microversion: 2.20 time: 0.325676 May 16 15:26:49.506007 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 562/1109] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 16 15:26:49 2022] DELETE /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 15:26:49.514164 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0ce48956-d081-483f-a685-9f75b015012a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:49.514832 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0ce48956-d081-483f-a685-9f75b015012a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:49.521429 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ce48956-d081-483f-a685-9f75b015012a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:49.525196 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ce48956-d081-483f-a685-9f75b015012a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:49.525196 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ce48956-d081-483f-a685-9f75b015012a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:49.525196 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ce48956-d081-483f-a685-9f75b015012a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:49.647462 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0ce48956-d081-483f-a685-9f75b015012a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:49.655741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0ce48956-d081-483f-a685-9f75b015012a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:49.657233 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0ce48956-d081-483f-a685-9f75b015012a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:49.658397 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0ce48956-d081-483f-a685-9f75b015012a tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.148244 May 16 15:26:49.658948 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 548/1110] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:49 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:26:50.677804 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-daff711d-51ac-4a12-a447-5e2f7514c768 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:50.678942 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-daff711d-51ac-4a12-a447-5e2f7514c768 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:50.685884 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-daff711d-51ac-4a12-a447-5e2f7514c768 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:50.686378 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-daff711d-51ac-4a12-a447-5e2f7514c768 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:50.687171 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-daff711d-51ac-4a12-a447-5e2f7514c768 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:50.687686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-daff711d-51ac-4a12-a447-5e2f7514c768 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:50.819545 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-daff711d-51ac-4a12-a447-5e2f7514c768 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:50.827362 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-daff711d-51ac-4a12-a447-5e2f7514c768 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:50.828889 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-daff711d-51ac-4a12-a447-5e2f7514c768 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:50.830031 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-daff711d-51ac-4a12-a447-5e2f7514c768 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1723 microversion: 2.20 time: 0.156886 May 16 15:26:50.830877 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 563/1111] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:50 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:51.849623 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e37fb3f5-4bdd-4693-ac1c-c17da9feb4f6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:51.850587 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e37fb3f5-4bdd-4693-ac1c-c17da9feb4f6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:51.858406 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e37fb3f5-4bdd-4693-ac1c-c17da9feb4f6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:51.859049 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e37fb3f5-4bdd-4693-ac1c-c17da9feb4f6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:51.860473 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e37fb3f5-4bdd-4693-ac1c-c17da9feb4f6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:51.861071 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e37fb3f5-4bdd-4693-ac1c-c17da9feb4f6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:51.949384 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e37fb3f5-4bdd-4693-ac1c-c17da9feb4f6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:51.959843 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e37fb3f5-4bdd-4693-ac1c-c17da9feb4f6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:51.961919 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e37fb3f5-4bdd-4693-ac1c-c17da9feb4f6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7788bd93c7649368e3fc926a969c7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440329d501de48d19ba51dceaa845197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:51.963251 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e37fb3f5-4bdd-4693-ac1c-c17da9feb4f6 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 200 len: 1655 microversion: 2.20 time: 0.118440 May 16 15:26:51.964318 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 564/1112] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:51 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 1655 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:52.008774 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-c3c47a2b-ed5d-492f-8eaf-d9e29c8415aa req-52251db3-c4fe-4e83-a0ad-04b6feeafead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7340ea8-184f-46fc-beb8-8b4930ad0084", "name": "network-vif-deleted", "tag": "4ca14e95-d4f6-4b13-9f5f-86987c637e51"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:52.019592 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-c3c47a2b-ed5d-492f-8eaf-d9e29c8415aa req-52251db3-c4fe-4e83-a0ad-04b6feeafead service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:52.020325 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-c3c47a2b-ed5d-492f-8eaf-d9e29c8415aa req-52251db3-c4fe-4e83-a0ad-04b6feeafead service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:52.035078 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-c3c47a2b-ed5d-492f-8eaf-d9e29c8415aa req-52251db3-c4fe-4e83-a0ad-04b6feeafead service nova] Creating event network-vif-deleted:4ca14e95-d4f6-4b13-9f5f-86987c637e51 for instance e7340ea8-184f-46fc-beb8-8b4930ad0084 on hv-cinder-79578 May 16 15:26:52.041852 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-c3c47a2b-ed5d-492f-8eaf-d9e29c8415aa req-52251db3-c4fe-4e83-a0ad-04b6feeafead service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209283 May 16 15:26:52.041852 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 549/1113] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:52.983388 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cb54ad3c-46b5-483a-bc6a-4690de5745fe tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:52.984019 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cb54ad3c-46b5-483a-bc6a-4690de5745fe tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:52.990377 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb54ad3c-46b5-483a-bc6a-4690de5745fe tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:52.990817 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb54ad3c-46b5-483a-bc6a-4690de5745fe tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:52.991570 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb54ad3c-46b5-483a-bc6a-4690de5745fe tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:52.992613 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb54ad3c-46b5-483a-bc6a-4690de5745fe tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:53.005689 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-cb54ad3c-46b5-483a-bc6a-4690de5745fe tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] HTTP exception thrown: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cb54ad3c-46b5-483a-bc6a-4690de5745fe tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Request method failure captured: May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 HTTP/1.1 May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmvq08AxiGXF5HUglRkHV86jS8ag85NuYNjnwKZGODg4Rsnt9cNhjiLTcfj0x7t00dSn88tFps7Rhdc3-c1UrFiwOE1rmN4ygv92qokmfM0cI-KfztBUPn-X7nCllOSyJ6CSy5lIXzQLJsjLgzmLJD-Gx_Yp5W8RxSgpjoGNi6QXXaI May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 440329d501de48d19ba51dceaa845197 May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:26:53.007348 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/440329d501de48d19ba51dceaa845197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_440329d501de48d19ba51dceaa845197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 440329d501de48d19ba51dceaa845197 May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: c7788bd93c7649368e3fc926a969c7ed May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:53.009183 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'e7340ea8-184f-46fc-beb8-8b4930ad0084'} May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:26:53.010288 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:53.011937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:53.013507 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cb54ad3c-46b5-483a-bc6a-4690de5745fe tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Returning 404 to user: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:26:53.013507 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cb54ad3c-46b5-483a-bc6a-4690de5745fe tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 404 len: 111 microversion: 2.20 time: 0.029201 May 16 15:26:53.013507 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 565/1114] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:52 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:26:53.018534 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7c73a865-1e5a-41c6-9029-8be0a806a4c3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '.version_select at 0x7fc9a6ed4940>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:53.077833 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7c73a865-1e5a-41c6-9029-8be0a806a4c3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006847946" status: 204 len: 0 microversion: 2.20 time: 0.063945 May 16 15:26:53.078564 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 550/1115] 10.222.0.44 () {60 vars in 1261 bytes} [Mon May 16 15:26:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006847946 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 15:26:55.019025 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fc8dafaa-14af-460d-9f5d-b76dcbdd16c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:55.019498 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fc8dafaa-14af-460d-9f5d-b76dcbdd16c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:55.026459 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8dafaa-14af-460d-9f5d-b76dcbdd16c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:55.026898 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8dafaa-14af-460d-9f5d-b76dcbdd16c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:55.027646 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8dafaa-14af-460d-9f5d-b76dcbdd16c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:55.028074 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc8dafaa-14af-460d-9f5d-b76dcbdd16c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:55.043701 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-fc8dafaa-14af-460d-9f5d-b76dcbdd16c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] HTTP exception thrown: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fc8dafaa-14af-460d-9f5d-b76dcbdd16c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Request method failure captured: May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 HTTP/1.1 May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmvq08AxiGXF5HUglRkHV86jS8ag85NuYNjnwKZGODg4Rsnt9cNhjiLTcfj0x7t00dSn88tFps7Rhdc3-c1UrFiwOE1rmN4ygv92qokmfM0cI-KfztBUPn-X7nCllOSyJ6CSy5lIXzQLJsjLgzmLJD-Gx_Yp5W8RxSgpjoGNi6QXXaI May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 440329d501de48d19ba51dceaa845197 May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:26:55.045217 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/440329d501de48d19ba51dceaa845197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_440329d501de48d19ba51dceaa845197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 440329d501de48d19ba51dceaa845197 May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: c7788bd93c7649368e3fc926a969c7ed May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:55.046954 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'e7340ea8-184f-46fc-beb8-8b4930ad0084'} May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:26:55.047886 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:55.049146 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:55.050760 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fc8dafaa-14af-460d-9f5d-b76dcbdd16c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Returning 404 to user: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:26:55.050760 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fc8dafaa-14af-460d-9f5d-b76dcbdd16c1 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 404 len: 111 microversion: 2.20 time: 0.031520 May 16 15:26:55.050760 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 566/1116] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 16 15:26:55 2022] DELETE /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:26:55.055393 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-df65d42d-4258-48a0-b110-d6425fffdbc3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:55.056112 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-df65d42d-4258-48a0-b110-d6425fffdbc3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: e7340ea8-184f-46fc-beb8-8b4930ad0084] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:55.062590 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-df65d42d-4258-48a0-b110-d6425fffdbc3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:55.063034 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-df65d42d-4258-48a0-b110-d6425fffdbc3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:55.063789 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-df65d42d-4258-48a0-b110-d6425fffdbc3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:55.064218 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-df65d42d-4258-48a0-b110-d6425fffdbc3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:55.079355 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-df65d42d-4258-48a0-b110-d6425fffdbc3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] HTTP exception thrown: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-df65d42d-4258-48a0-b110-d6425fffdbc3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Request method failure captured: May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 HTTP/1.1 May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmvq08AxiGXF5HUglRkHV86jS8ag85NuYNjnwKZGODg4Rsnt9cNhjiLTcfj0x7t00dSn88tFps7Rhdc3-c1UrFiwOE1rmN4ygv92qokmfM0cI-KfztBUPn-X7nCllOSyJ6CSy5lIXzQLJsjLgzmLJD-Gx_Yp5W8RxSgpjoGNi6QXXaI May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: 440329d501de48d19ba51dceaa845197 May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:26:55.080983 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/440329d501de48d19ba51dceaa845197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_440329d501de48d19ba51dceaa845197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 440329d501de48d19ba51dceaa845197 May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: c7788bd93c7649368e3fc926a969c7ed May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:55.082765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': 'e7340ea8-184f-46fc-beb8-8b4930ad0084'} May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:26:55.083858 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. May 16 15:26:55.085448 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:26:55.087669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-df65d42d-4258-48a0-b110-d6425fffdbc3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Returning 404 to user: Instance e7340ea8-184f-46fc-beb8-8b4930ad0084 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:26:55.087669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-df65d42d-4258-48a0-b110-d6425fffdbc3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084" status: 404 len: 111 microversion: 2.20 time: 0.031237 May 16 15:26:55.087669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 551/1117] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:55 2022] GET /compute/v2.1/servers/e7340ea8-184f-46fc-beb8-8b4930ad0084 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:26:56.322295 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e309b138-6f01-4dd2-8f03-4ae7b29c4db5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:56.322784 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e309b138-6f01-4dd2-8f03-4ae7b29c4db5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:56.331924 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e309b138-6f01-4dd2-8f03-4ae7b29c4db5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:56.331924 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e309b138-6f01-4dd2-8f03-4ae7b29c4db5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:56.331924 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e309b138-6f01-4dd2-8f03-4ae7b29c4db5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:56.331924 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e309b138-6f01-4dd2-8f03-4ae7b29c4db5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:56.344102 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-e309b138-6f01-4dd2-8f03-4ae7b29c4db5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] HTTP exception thrown: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e309b138-6f01-4dd2-8f03-4ae7b29c4db5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Request method failure captured: May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 HTTP/1.1 May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmvq08AxiGXF5HUglRkHV86jS8ag85NuYNjnwKZGODg4Rsnt9cNhjiLTcfj0x7t00dSn88tFps7Rhdc3-c1UrFiwOE1rmN4ygv92qokmfM0cI-KfztBUPn-X7nCllOSyJ6CSy5lIXzQLJsjLgzmLJD-Gx_Yp5W8RxSgpjoGNi6QXXaI May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 440329d501de48d19ba51dceaa845197 May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:26:56.345647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/440329d501de48d19ba51dceaa845197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_440329d501de48d19ba51dceaa845197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 440329d501de48d19ba51dceaa845197 May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: c7788bd93c7649368e3fc926a969c7ed May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:26:56.347432 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '50535581-9ba0-49d7-83c8-5b46113c41f2'} May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:26:56.348270 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:26:56.349590 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:26:56.350938 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e309b138-6f01-4dd2-8f03-4ae7b29c4db5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Returning 404 to user: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:26:56.350938 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e309b138-6f01-4dd2-8f03-4ae7b29c4db5 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "DELETE /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 404 len: 111 microversion: 2.20 time: 0.029331 May 16 15:26:56.350938 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 567/1118] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 16 15:26:56 2022] DELETE /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:26:56.355288 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-110cbef8-4239-4e8b-a62e-c12e71bac6b3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:56.355888 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-110cbef8-4239-4e8b-a62e-c12e71bac6b3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] [instance: 50535581-9ba0-49d7-83c8-5b46113c41f2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:56.362158 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-110cbef8-4239-4e8b-a62e-c12e71bac6b3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:56.362605 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-110cbef8-4239-4e8b-a62e-c12e71bac6b3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:56.363359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-110cbef8-4239-4e8b-a62e-c12e71bac6b3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:56.363788 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-110cbef8-4239-4e8b-a62e-c12e71bac6b3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:56.377449 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-110cbef8-4239-4e8b-a62e-c12e71bac6b3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] HTTP exception thrown: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-110cbef8-4239-4e8b-a62e-c12e71bac6b3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Request method failure captured: May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 HTTP/1.1 May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigmvq08AxiGXF5HUglRkHV86jS8ag85NuYNjnwKZGODg4Rsnt9cNhjiLTcfj0x7t00dSn88tFps7Rhdc3-c1UrFiwOE1rmN4ygv92qokmfM0cI-KfztBUPn-X7nCllOSyJ6CSy5lIXzQLJsjLgzmLJD-Gx_Yp5W8RxSgpjoGNi6QXXaI May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: 440329d501de48d19ba51dceaa845197 May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:26:56.379036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/440329d501de48d19ba51dceaa845197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/440329d501de48d19ba51dceaa845197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_440329d501de48d19ba51dceaa845197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 440329d501de48d19ba51dceaa845197 May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44441582 May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: c7788bd93c7649368e3fc926a969c7ed May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44441582-project May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: > May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:26:56.380962 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '50535581-9ba0-49d7-83c8-5b46113c41f2'} May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:26:56.381960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. May 16 15:26:56.384253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:26:56.385644 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-110cbef8-4239-4e8b-a62e-c12e71bac6b3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] Returning 404 to user: Instance 50535581-9ba0-49d7-83c8-5b46113c41f2 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:26:56.385644 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-110cbef8-4239-4e8b-a62e-c12e71bac6b3 tempest-AttachVolumeShelveTestJSON-44441582 tempest-AttachVolumeShelveTestJSON-44441582-project] 10.222.0.44 "GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2" status: 404 len: 111 microversion: 2.20 time: 0.029021 May 16 15:26:56.385644 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 552/1119] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 16 15:26:56 2022] GET /compute/v2.1/servers/50535581-9ba0-49d7-83c8-5b46113c41f2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:27:01.698322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4dc52dbe-bbf0-443c-8fcc-8f045ed34ea4 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Action: 'create', calling method: .version_select at 0x7fc9a7efbee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1092545852"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:02.331662 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4dc52dbe-bbf0-443c-8fcc-8f045ed34ea4 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.743393 May 16 15:27:02.332284 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 568/1120] 10.222.0.44 () {60 vars in 1154 bytes} [Mon May 16 15:27:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 745 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 15:27:02.343123 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fafb3228-5600-4a65-a842-f2e37c316fb8 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a6ed4940>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:02.393274 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fafb3228-5600-4a65-a842-f2e37c316fb8 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323" status: 200 len: 345 microversion: 2.1 time: 0.051992 May 16 15:27:02.393274 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 553/1121] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:27:02 2022] GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:03.406911 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bbbadf88-11a4-48e1-969c-e927cc54cd95 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a739a9d0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:03.452605 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bbbadf88-11a4-48e1-969c-e927cc54cd95 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323" status: 200 len: 346 microversion: 2.1 time: 0.051593 May 16 15:27:03.453168 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 569/1122] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:27:03 2022] GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:03.465643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c2d6ef0e-0fdc-4760-a45d-b290e44bcc61 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Action: 'create', calling method: .version_select at 0x7fc9a6e27b80>, body: {"snapshot": {"volume_id": "1f68646c-f313-4064-8c4d-3e2e6b9ff323", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1145512425"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:03.923641 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c2d6ef0e-0fdc-4760-a45d-b290e44bcc61 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.463117 May 16 15:27:03.924230 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 554/1123] 10.222.0.44 () {60 vars in 1161 bytes} [Mon May 16 15:27:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:03.934752 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bd3c22cb-5de0-421c-9d16-45615113a4e3 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a7efb280>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:03.962647 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bd3c22cb-5de0-421c-9d16-45615113a4e3 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d" status: 200 len: 287 microversion: 2.1 time: 0.032685 May 16 15:27:03.963232 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 570/1124] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 16 15:27:03 2022] GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:03.978640 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3bf689a7-def2-4d88-9a21-642ee4e4950a tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a6c7ed30>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:04.002539 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3bf689a7-def2-4d88-9a21-642ee4e4950a tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032923 May 16 15:27:04.003111 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 555/1125] 10.222.0.44 () {58 vars in 1139 bytes} [Mon May 16 15:27:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:04.012948 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eaa02915-000a-4380-8ea8-5cc2a9d06cc0 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a7f81940>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:04.042186 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eaa02915-000a-4380-8ea8-5cc2a9d06cc0 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d" status: 200 len: 287 microversion: 2.1 time: 0.032755 May 16 15:27:04.042852 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 571/1126] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 16 15:27:04 2022] GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:05.054359 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-08c6e863-164e-4644-acd4-b16e14e9c6b7 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a6e05820>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:05.082975 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-08c6e863-164e-4644-acd4-b16e14e9c6b7 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d" status: 200 len: 287 microversion: 2.1 time: 0.032877 May 16 15:27:05.083536 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 556/1127] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 16 15:27:05 2022] GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:06.095428 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c590b42d-a62f-4e66-971f-0e1f04a1e489 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a739a430>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:06.124071 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c590b42d-a62f-4e66-971f-0e1f04a1e489 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d" status: 200 len: 287 microversion: 2.1 time: 0.033046 May 16 15:27:06.124618 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 572/1128] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 16 15:27:06 2022] GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:07.136751 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c7388e3f-722f-4619-a978-904223786a0f tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a6be4dc0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:07.166765 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c7388e3f-722f-4619-a978-904223786a0f tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d" status: 200 len: 288 microversion: 2.1 time: 0.034813 May 16 15:27:07.167322 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 557/1129] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 16 15:27:07 2022] GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:27:07.177777 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5e8394d8-c8f9-4ef2-b84c-2cd48b02aac8 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a7f81940>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:07.316707 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5e8394d8-c8f9-4ef2-b84c-2cd48b02aac8 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d" status: 202 len: 0 microversion: 2.1 time: 0.143180 May 16 15:27:07.317576 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 573/1130] 10.222.0.44 () {58 vars in 1253 bytes} [Mon May 16 15:27:07 2022] DELETE /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:07.326277 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-511bb0fb-0333-4827-b8b3-1017a10b87a0 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a6e05550>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:07.354283 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-511bb0fb-0333-4827-b8b3-1017a10b87a0 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d" status: 200 len: 287 microversion: 2.1 time: 0.032458 May 16 15:27:07.354839 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 558/1131] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 16 15:27:07 2022] GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:08.366278 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-61ab5917-aac8-42fd-bce1-0f725bb913a5 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a72c4b80>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:08.389081 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-61ab5917-aac8-42fd-bce1-0f725bb913a5 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] HTTP exception thrown: Snapshot efd21214-5fa1-41fc-9538-82e04c7dbf5d could not be found. May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-61ab5917-aac8-42fd-bce1-0f725bb913a5 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Request method failure captured: May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d HTTP/1.1 May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigm1Fxrl1xphQnjSc56tbwxAfVaRvq748sedeTd01WcTH54XT4SyRxLqWUOHm-Oqz1TE9E79vvS9Bc3iVTF53DB3ooUWYru-k4rYPiJEeqdhVQSVgrNMdcr_BZboHcSzukUSXEnRCaAOyW_LLMP7r3Kx0yggadB7Ctspqy47q-Ii_r94 May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: a9ed30c4f75f4162845669a1db3a86dc May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:27:08.391323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: a9ed30c4f75f4162845669a1db3a86dc May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesSnapshotsTestJSON-1781244021-project May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 3637f71a50164e9fac7cf57a87a3dae0 May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1781244021-project May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Snapshot efd21214-5fa1-41fc-9538-82e04c7dbf5d could not be found. May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'efd21214-5fa1-41fc-9538-82e04c7dbf5d'} May 16 15:27:08.393006 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot efd21214-5fa1-41fc-9538-82e04c7dbf5d could not be found. (HTTP 404) (Request-ID: req-83ff0e32-8a04-4eef-9ad2-5f3946fc22a9) May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:08.394048 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:27:08.395322 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot efd21214-5fa1-41fc-9538-82e04c7dbf5d could not be found. May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 16 15:27:08.396615 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot efd21214-5fa1-41fc-9538-82e04c7dbf5d could not be found. May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot efd21214-5fa1-41fc-9538-82e04c7dbf5d could not be found. May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-61ab5917-aac8-42fd-bce1-0f725bb913a5 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Returning 404 to user: Snapshot efd21214-5fa1-41fc-9538-82e04c7dbf5d could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:08.398209 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-61ab5917-aac8-42fd-bce1-0f725bb913a5 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d" status: 404 len: 111 microversion: 2.1 time: 0.030787 May 16 15:27:08.399346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 574/1132] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 16 15:27:08 2022] GET /compute/v2.1/os-snapshots/efd21214-5fa1-41fc-9538-82e04c7dbf5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:27:08.402888 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-60e614f9-7fdc-4f9b-8b26-45606cf4f71c tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a6ed49d0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:08.620077 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-60e614f9-7fdc-4f9b-8b26-45606cf4f71c tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323" status: 202 len: 0 microversion: 2.1 time: 0.222591 May 16 15:27:08.620743 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 559/1133] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 16 15:27:08 2022] DELETE /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:08.629515 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-558a2887-c7c0-4df6-a787-31652e533e98 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a7ea3f70>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:08.676115 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-558a2887-c7c0-4df6-a787-31652e533e98 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323" status: 200 len: 345 microversion: 2.1 time: 0.050426 May 16 15:27:08.676710 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 575/1134] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:27:08 2022] GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:09.689395 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0ed26ee6-6bc8-44df-917b-440bed794866 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a6be45e0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:09.716167 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-0ed26ee6-6bc8-44df-917b-440bed794866 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] HTTP exception thrown: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0ed26ee6-6bc8-44df-917b-440bed794866 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Request method failure captured: May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323 HTTP/1.1 May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigm1Fxrl1xphQnjSc56tbwxAfVaRvq748sedeTd01WcTH54XT4SyRxLqWUOHm-Oqz1TE9E79vvS9Bc3iVTF53DB3ooUWYru-k4rYPiJEeqdhVQSVgrNMdcr_BZboHcSzukUSXEnRCaAOyW_LLMP7r3Kx0yggadB7Ctspqy47q-Ii_r94 May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: a9ed30c4f75f4162845669a1db3a86dc May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:27:09.718107 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: a9ed30c4f75f4162845669a1db3a86dc May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesSnapshotsTestJSON-1781244021-project May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 3637f71a50164e9fac7cf57a87a3dae0 May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1781244021-project May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '1f68646c-f313-4064-8c4d-3e2e6b9ff323'} May 16 15:27:09.719643 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. (HTTP 404) (Request-ID: req-805bb8c3-5e52-4ea7-948b-d217efaebe60) May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:09.720599 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:27:09.722135 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:27:09.723746 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0ed26ee6-6bc8-44df-917b-440bed794866 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Returning 404 to user: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0ed26ee6-6bc8-44df-917b-440bed794866 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323" status: 404 len: 109 microversion: 2.1 time: 0.034512 May 16 15:27:09.725316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 560/1135] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:27:09 2022] GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:27:09.730143 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1c2d1b47-4656-4cb6-a7f0-793aa9007782 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a739a3a0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:09.759277 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-1c2d1b47-4656-4cb6-a7f0-793aa9007782 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] HTTP exception thrown: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1c2d1b47-4656-4cb6-a7f0-793aa9007782 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Request method failure captured: May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323 HTTP/1.1 May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigm1Fxrl1xphQnjSc56tbwxAfVaRvq748sedeTd01WcTH54XT4SyRxLqWUOHm-Oqz1TE9E79vvS9Bc3iVTF53DB3ooUWYru-k4rYPiJEeqdhVQSVgrNMdcr_BZboHcSzukUSXEnRCaAOyW_LLMP7r3Kx0yggadB7Ctspqy47q-Ii_r94 May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: a9ed30c4f75f4162845669a1db3a86dc May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:27:09.761233 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: a9ed30c4f75f4162845669a1db3a86dc May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesSnapshotsTestJSON-1781244021-project May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 3637f71a50164e9fac7cf57a87a3dae0 May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1781244021-project May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '1f68646c-f313-4064-8c4d-3e2e6b9ff323'} May 16 15:27:09.762910 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. (HTTP 404) (Request-ID: req-cc5b3364-1a11-4927-9fe4-75af072042c6) May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:09.764076 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:27:09.765544 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 15:27:09.767182 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1c2d1b47-4656-4cb6-a7f0-793aa9007782 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Returning 404 to user: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:09.768652 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1c2d1b47-4656-4cb6-a7f0-793aa9007782 tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323" status: 404 len: 109 microversion: 2.1 time: 0.037529 May 16 15:27:09.769650 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 576/1136] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 16 15:27:09 2022] DELETE /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:27:09.771156 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bc849cac-8868-4466-a1fa-85ecf3f4824c tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Calling method '.version_select at 0x7fc9a6c7eaf0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:09.802328 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-bc849cac-8868-4466-a1fa-85ecf3f4824c tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] HTTP exception thrown: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bc849cac-8868-4466-a1fa-85ecf3f4824c tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Request method failure captured: May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323 HTTP/1.1 May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept: application/json May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Connection: close May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Length: 0 May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Content-Type: application/json May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Host: 10.222.0.44 May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABigm1Fxrl1xphQnjSc56tbwxAfVaRvq748sedeTd01WcTH54XT4SyRxLqWUOHm-Oqz1TE9E79vvS9Bc3iVTF53DB3ooUWYru-k4rYPiJEeqdhVQSVgrNMdcr_BZboHcSzukUSXEnRCaAOyW_LLMP7r3Kx0yggadB7Ctspqy47q-Ii_r94 May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Id: None May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Domain-Name: None May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Id: a9ed30c4f75f4162845669a1db3a86dc May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Role: reader,member May 16 15:27:09.804240 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Roles: reader,member May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a9ed30c4f75f4162845669a1db3a86dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Id: a9ed30c4f75f4162845669a1db3a86dc May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1781244021 May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesSnapshotsTestJSON-1781244021-project May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Id: 3637f71a50164e9fac7cf57a87a3dae0 May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1781244021-project May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: method: May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: exception: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: action_args: {'id': '1f68646c-f313-4064-8c4d-3e2e6b9ff323'} May 16 15:27:09.805895 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. (HTTP 404) (Request-ID: req-448c6326-47e3-400a-9fe9-56990c2f7ae5) May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:09.806930 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:27:09.808346 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:27:09.809793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bc849cac-8868-4466-a1fa-85ecf3f4824c tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] Returning 404 to user: Volume 1f68646c-f313-4064-8c4d-3e2e6b9ff323 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bc849cac-8868-4466-a1fa-85ecf3f4824c tempest-VolumesSnapshotsTestJSON-1781244021 tempest-VolumesSnapshotsTestJSON-1781244021-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323" status: 404 len: 109 microversion: 2.1 time: 0.038419 May 16 15:27:09.811289 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 561/1137] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:27:09 2022] GET /compute/v2.1/os-volumes/1f68646c-f313-4064-8c4d-3e2e6b9ff323 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:27:11.806408 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9b7f37f2-a3c7-41f9-bfff-8e6f4af76b7f tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] Action: 'create', calling method: .version_select at 0x7fc9a739adc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1511139303", "metadata": {"Type": "work"}}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:12.389517 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9b7f37f2-a3c7-41f9-bfff-8e6f4af76b7f tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.699789 May 16 15:27:12.390149 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 577/1138] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 16 15:27:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 701 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 15:27:12.402259 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-641ef3de-cabf-42ae-8018-978255a6f5b3 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] Calling method '.version_select at 0x7fc9a6eeb550>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:12.449727 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-641ef3de-cabf-42ae-8018-978255a6f5b3 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da" status: 200 len: 353 microversion: 2.1 time: 0.052630 May 16 15:27:12.450416 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 562/1139] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:27:12 2022] GET /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:13.462721 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f7c09807-5bff-4cb3-a8e2-e997331fe488 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] Calling method '.version_select at 0x7fc9ac09b430>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:13.507305 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f7c09807-5bff-4cb3-a8e2-e997331fe488 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da" status: 200 len: 354 microversion: 2.1 time: 0.048942 May 16 15:27:13.507874 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 578/1140] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:27:13 2022] GET /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:13.519648 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ed5b2d56-0ac9-40ad-8636-46128d97e613 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] Calling method '.version_select at 0x7fc9a6c7eaf0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:13.564446 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ed5b2d56-0ac9-40ad-8636-46128d97e613 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da" status: 200 len: 354 microversion: 2.1 time: 0.048991 May 16 15:27:13.565006 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 563/1141] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:27:13 2022] GET /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:13.581141 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c0ce3b1c-fe9d-48bd-85e9-dce37bc6520a tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] Calling method '.version_select at 0x7fc9a7226d30>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:13.751783 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c0ce3b1c-fe9d-48bd-85e9-dce37bc6520a tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da" status: 202 len: 0 microversion: 2.1 time: 0.174350 May 16 15:27:13.752355 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 579/1142] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 16 15:27:13 2022] DELETE /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:13.760529 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-87abf51a-f25f-4465-8cb9-d8ab850d0b86 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] Calling method '.version_select at 0x7fc9a6fc2c10>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:13.804521 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-87abf51a-f25f-4465-8cb9-d8ab850d0b86 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da" status: 200 len: 353 microversion: 2.1 time: 0.047734 May 16 15:27:13.805081 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 564/1143] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:27:13 2022] GET /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:14.817159 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-75be9b69-cc05-41c6-b517-b04340986e01 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] Calling method '.version_select at 0x7fc9a742cee0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:14.844052 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-75be9b69-cc05-41c6-b517-b04340986e01 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] HTTP exception thrown: Volume e0989b24-e1e2-4ecd-987d-12081215e7da could not be found. May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-75be9b69-cc05-41c6-b517-b04340986e01 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] Request method failure captured: May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da HTTP/1.1 May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigm1PyJeY4rTmRJtZ53pzzKP75y-IgcQ5f-OrzNpz7AALCrMn2mCRTlJZZ4fwo8MPjyI3QmU20R67nCVgvgPK2wo7pFB9R8mCGJZCcc-E_fv-AdaUdOFQ49Um1lp3jH9Pz7CkyRsTDMrNcB9T13_81k14e6LgeMvQcXOVc71vPY0s-hw May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 56b0022171474dac9ed310332102dca2 May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesGetTestJSON-1394279300 May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:27:14.846002 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/56b0022171474dac9ed310332102dca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/56b0022171474dac9ed310332102dca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/56b0022171474dac9ed310332102dca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_56b0022171474dac9ed310332102dca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesGetTestJSON-1394279300 May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 56b0022171474dac9ed310332102dca2 May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesGetTestJSON-1394279300 May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesGetTestJSON-1394279300-project May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 14ca028080594039bcf38cf6468dff52 May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesGetTestJSON-1394279300-project May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Volume e0989b24-e1e2-4ecd-987d-12081215e7da could not be found. May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': 'e0989b24-e1e2-4ecd-987d-12081215e7da'} May 16 15:27:14.847747 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e0989b24-e1e2-4ecd-987d-12081215e7da could not be found. (HTTP 404) (Request-ID: req-d0393cc4-be30-424b-91ba-3aa31a436c4e) May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:14.848985 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:27:14.850566 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e0989b24-e1e2-4ecd-987d-12081215e7da could not be found. May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:27:14.852211 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e0989b24-e1e2-4ecd-987d-12081215e7da could not be found. May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e0989b24-e1e2-4ecd-987d-12081215e7da could not be found. May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-75be9b69-cc05-41c6-b517-b04340986e01 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] Returning 404 to user: Volume e0989b24-e1e2-4ecd-987d-12081215e7da could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-75be9b69-cc05-41c6-b517-b04340986e01 tempest-VolumesGetTestJSON-1394279300 tempest-VolumesGetTestJSON-1394279300-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da" status: 404 len: 109 microversion: 2.1 time: 0.034608 May 16 15:27:14.854112 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 580/1144] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 16 15:27:14 2022] GET /compute/v2.1/os-volumes/e0989b24-e1e2-4ecd-987d-12081215e7da => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:27:38.143037 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-aaf2dffa-60ba-4182-a147-28ed0f9a9831 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:38.143577 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-aaf2dffa-60ba-4182-a147-28ed0f9a9831 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:38.149537 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aaf2dffa-60ba-4182-a147-28ed0f9a9831 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:38.149992 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aaf2dffa-60ba-4182-a147-28ed0f9a9831 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:38.150797 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aaf2dffa-60ba-4182-a147-28ed0f9a9831 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:38.151758 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aaf2dffa-60ba-4182-a147-28ed0f9a9831 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:38.174365 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-aaf2dffa-60ba-4182-a147-28ed0f9a9831 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lazy-loading 'flavor' on Instance uuid 5e407782-18cb-44c7-aeb5-95be87554fb8 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:27:38.448528 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-aaf2dffa-60ba-4182-a147-28ed0f9a9831 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "POST /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.309796 May 16 15:27:38.449295 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 565/1145] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:27:38 2022] POST /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:38.457760 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dd8e6a91-6488-4376-adaf-1b503fd75b33 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:38.458384 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dd8e6a91-6488-4376-adaf-1b503fd75b33 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:38.467012 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd8e6a91-6488-4376-adaf-1b503fd75b33 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:38.469760 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd8e6a91-6488-4376-adaf-1b503fd75b33 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:38.469760 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd8e6a91-6488-4376-adaf-1b503fd75b33 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:38.469760 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd8e6a91-6488-4376-adaf-1b503fd75b33 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:38.602712 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dd8e6a91-6488-4376-adaf-1b503fd75b33 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:38.610011 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dd8e6a91-6488-4376-adaf-1b503fd75b33 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.156066 May 16 15:27:38.610606 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 581/1146] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:38 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:39.628623 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6bfc4c02-0b4c-46de-bf9a-71199885c1ce tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:39.629318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6bfc4c02-0b4c-46de-bf9a-71199885c1ce tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:39.635326 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6bfc4c02-0b4c-46de-bf9a-71199885c1ce tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:39.635773 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6bfc4c02-0b4c-46de-bf9a-71199885c1ce tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:39.636537 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6bfc4c02-0b4c-46de-bf9a-71199885c1ce tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:39.636979 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6bfc4c02-0b4c-46de-bf9a-71199885c1ce tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:39.763027 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6bfc4c02-0b4c-46de-bf9a-71199885c1ce tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:39.770331 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6bfc4c02-0b4c-46de-bf9a-71199885c1ce tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.146425 May 16 15:27:39.771071 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 566/1147] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:39 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:40.787841 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0f7f71d0-b102-4550-819e-1939965ff098 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:40.788491 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0f7f71d0-b102-4550-819e-1939965ff098 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:40.795994 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f7f71d0-b102-4550-819e-1939965ff098 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:40.796451 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f7f71d0-b102-4550-819e-1939965ff098 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:40.797234 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f7f71d0-b102-4550-819e-1939965ff098 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:40.797679 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f7f71d0-b102-4550-819e-1939965ff098 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:40.928965 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0f7f71d0-b102-4550-819e-1939965ff098 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:40.936876 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0f7f71d0-b102-4550-819e-1939965ff098 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.152836 May 16 15:27:40.937487 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 582/1148] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:40 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:41.954524 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c31c3f68-bfa5-478b-b27e-53d9b405ed62 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:41.955140 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c31c3f68-bfa5-478b-b27e-53d9b405ed62 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:41.961382 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c31c3f68-bfa5-478b-b27e-53d9b405ed62 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:41.961830 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c31c3f68-bfa5-478b-b27e-53d9b405ed62 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:41.962623 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c31c3f68-bfa5-478b-b27e-53d9b405ed62 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:41.963058 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c31c3f68-bfa5-478b-b27e-53d9b405ed62 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:42.097338 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c31c3f68-bfa5-478b-b27e-53d9b405ed62 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:42.104782 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c31c3f68-bfa5-478b-b27e-53d9b405ed62 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.153990 May 16 15:27:42.105296 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 567/1149] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:41 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:43.121986 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0e114c93-6a19-497e-960e-62cd69c1edc3 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:43.122682 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0e114c93-6a19-497e-960e-62cd69c1edc3 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:43.129172 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e114c93-6a19-497e-960e-62cd69c1edc3 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:43.138824 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e114c93-6a19-497e-960e-62cd69c1edc3 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:43.138824 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e114c93-6a19-497e-960e-62cd69c1edc3 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:43.138824 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e114c93-6a19-497e-960e-62cd69c1edc3 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:43.273277 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0e114c93-6a19-497e-960e-62cd69c1edc3 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:43.280745 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0e114c93-6a19-497e-960e-62cd69c1edc3 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.162673 May 16 15:27:43.281323 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 583/1150] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:43 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:44.385206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f1964b7b-157e-4ab5-9cef-5eb9b5f04508 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:44.385206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f1964b7b-157e-4ab5-9cef-5eb9b5f04508 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:44.385206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1964b7b-157e-4ab5-9cef-5eb9b5f04508 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:44.385206 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1964b7b-157e-4ab5-9cef-5eb9b5f04508 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:44.387854 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1964b7b-157e-4ab5-9cef-5eb9b5f04508 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:44.387854 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f1964b7b-157e-4ab5-9cef-5eb9b5f04508 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:44.439234 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f1964b7b-157e-4ab5-9cef-5eb9b5f04508 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:44.446851 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f1964b7b-157e-4ab5-9cef-5eb9b5f04508 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.152241 May 16 15:27:44.450494 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 568/1151] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:44 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:45.464655 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8cab9c14-205a-4638-880d-a6a88efa5038 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:45.466033 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8cab9c14-205a-4638-880d-a6a88efa5038 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:45.472813 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cab9c14-205a-4638-880d-a6a88efa5038 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:45.473262 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cab9c14-205a-4638-880d-a6a88efa5038 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:45.474063 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cab9c14-205a-4638-880d-a6a88efa5038 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:45.474517 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cab9c14-205a-4638-880d-a6a88efa5038 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:45.615630 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8cab9c14-205a-4638-880d-a6a88efa5038 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:45.623699 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8cab9c14-205a-4638-880d-a6a88efa5038 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.162819 May 16 15:27:45.624375 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 584/1152] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:45 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:46.640717 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8d87bd66-d74f-4b00-ac09-bc4c2ed7261f tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:46.641318 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8d87bd66-d74f-4b00-ac09-bc4c2ed7261f tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:46.647669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d87bd66-d74f-4b00-ac09-bc4c2ed7261f tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:46.648115 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d87bd66-d74f-4b00-ac09-bc4c2ed7261f tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:46.648881 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d87bd66-d74f-4b00-ac09-bc4c2ed7261f tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:46.649315 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d87bd66-d74f-4b00-ac09-bc4c2ed7261f tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:46.781902 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8d87bd66-d74f-4b00-ac09-bc4c2ed7261f tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:46.789785 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8d87bd66-d74f-4b00-ac09-bc4c2ed7261f tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.153008 May 16 15:27:46.790385 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 569/1153] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:46 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:47.807425 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c5ecf389-b8b4-416d-96b9-19a18878d8bc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:47.808026 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c5ecf389-b8b4-416d-96b9-19a18878d8bc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:47.814902 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5ecf389-b8b4-416d-96b9-19a18878d8bc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:47.815347 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5ecf389-b8b4-416d-96b9-19a18878d8bc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:47.816107 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5ecf389-b8b4-416d-96b9-19a18878d8bc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:47.816558 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5ecf389-b8b4-416d-96b9-19a18878d8bc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:47.948645 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c5ecf389-b8b4-416d-96b9-19a18878d8bc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:47.956630 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c5ecf389-b8b4-416d-96b9-19a18878d8bc tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.153107 May 16 15:27:47.957192 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 585/1154] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:47 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:48.975098 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-43bc189e-5fda-4b28-8406-c4b69eefb999 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:48.978687 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-43bc189e-5fda-4b28-8406-c4b69eefb999 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:48.981546 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43bc189e-5fda-4b28-8406-c4b69eefb999 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:48.981985 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43bc189e-5fda-4b28-8406-c4b69eefb999 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:48.982829 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43bc189e-5fda-4b28-8406-c4b69eefb999 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:48.983253 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43bc189e-5fda-4b28-8406-c4b69eefb999 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:49.115836 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-43bc189e-5fda-4b28-8406-c4b69eefb999 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:49.123407 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-43bc189e-5fda-4b28-8406-c4b69eefb999 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.152577 May 16 15:27:49.124159 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 570/1155] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:48 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:50.140330 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9adca6e7-4a9a-4939-997a-22308dd7c01a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:50.140938 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9adca6e7-4a9a-4939-997a-22308dd7c01a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:50.147540 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9adca6e7-4a9a-4939-997a-22308dd7c01a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:50.147983 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9adca6e7-4a9a-4939-997a-22308dd7c01a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:50.148751 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9adca6e7-4a9a-4939-997a-22308dd7c01a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:50.149185 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9adca6e7-4a9a-4939-997a-22308dd7c01a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:50.277552 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9adca6e7-4a9a-4939-997a-22308dd7c01a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:50.285686 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9adca6e7-4a9a-4939-997a-22308dd7c01a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.149229 May 16 15:27:50.286291 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 586/1156] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:50 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:51.303517 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-242c8cba-8c0e-428b-9d90-d8b5722c5e26 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:51.304129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-242c8cba-8c0e-428b-9d90-d8b5722c5e26 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:51.310546 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-242c8cba-8c0e-428b-9d90-d8b5722c5e26 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:51.311633 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-242c8cba-8c0e-428b-9d90-d8b5722c5e26 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:51.312402 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-242c8cba-8c0e-428b-9d90-d8b5722c5e26 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:51.312874 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-242c8cba-8c0e-428b-9d90-d8b5722c5e26 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:51.441826 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-242c8cba-8c0e-428b-9d90-d8b5722c5e26 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:51.449495 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-242c8cba-8c0e-428b-9d90-d8b5722c5e26 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.149780 May 16 15:27:51.450088 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 571/1157] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:51 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:52.467261 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e80c44b3-3cb8-4991-b675-e07fe070db1e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:52.467862 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e80c44b3-3cb8-4991-b675-e07fe070db1e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:52.474402 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e80c44b3-3cb8-4991-b675-e07fe070db1e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:52.474845 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e80c44b3-3cb8-4991-b675-e07fe070db1e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:52.475599 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e80c44b3-3cb8-4991-b675-e07fe070db1e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:52.476029 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e80c44b3-3cb8-4991-b675-e07fe070db1e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:52.605439 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e80c44b3-3cb8-4991-b675-e07fe070db1e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:52.613248 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e80c44b3-3cb8-4991-b675-e07fe070db1e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1508 microversion: 2.1 time: 0.150097 May 16 15:27:52.613810 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 587/1158] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:52 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:52.629995 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3b1b1bca-f3fe-4c60-822c-9dc2bfe3cbd2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:52.630624 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3b1b1bca-f3fe-4c60-822c-9dc2bfe3cbd2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:52.636884 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b1b1bca-f3fe-4c60-822c-9dc2bfe3cbd2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:52.637331 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b1b1bca-f3fe-4c60-822c-9dc2bfe3cbd2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:52.638112 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b1b1bca-f3fe-4c60-822c-9dc2bfe3cbd2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:52.638548 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b1b1bca-f3fe-4c60-822c-9dc2bfe3cbd2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:52.844160 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3b1b1bca-f3fe-4c60-822c-9dc2bfe3cbd2 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "POST /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.218085 May 16 15:27:52.844797 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 572/1159] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 16 15:27:52 2022] POST /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:52.852934 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f0773c25-506b-44e5-ae75-86e8f32bdc8d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:52.853539 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f0773c25-506b-44e5-ae75-86e8f32bdc8d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:52.859812 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0773c25-506b-44e5-ae75-86e8f32bdc8d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:52.860261 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0773c25-506b-44e5-ae75-86e8f32bdc8d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:52.861019 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0773c25-506b-44e5-ae75-86e8f32bdc8d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:52.861446 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0773c25-506b-44e5-ae75-86e8f32bdc8d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:52.990489 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f0773c25-506b-44e5-ae75-86e8f32bdc8d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:52.997768 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f0773c25-506b-44e5-ae75-86e8f32bdc8d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1516 microversion: 2.1 time: 0.148696 May 16 15:27:52.998412 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 588/1160] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:52 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:54.016384 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ac88c88e-5747-4bca-ac38-acbc275a198c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:54.016903 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ac88c88e-5747-4bca-ac38-acbc275a198c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:54.022820 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac88c88e-5747-4bca-ac38-acbc275a198c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:54.023693 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac88c88e-5747-4bca-ac38-acbc275a198c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:54.024251 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac88c88e-5747-4bca-ac38-acbc275a198c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:54.024681 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ac88c88e-5747-4bca-ac38-acbc275a198c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:54.152493 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ac88c88e-5747-4bca-ac38-acbc275a198c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:54.159981 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ac88c88e-5747-4bca-ac38-acbc275a198c tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1516 microversion: 2.1 time: 0.148948 May 16 15:27:54.160552 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 573/1161] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:54 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:55.176644 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c80c804-7b60-499b-891a-e3ae5a08b713 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:55.177255 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c80c804-7b60-499b-891a-e3ae5a08b713 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:55.184373 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c80c804-7b60-499b-891a-e3ae5a08b713 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:55.184818 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c80c804-7b60-499b-891a-e3ae5a08b713 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:55.186846 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c80c804-7b60-499b-891a-e3ae5a08b713 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:55.192063 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c80c804-7b60-499b-891a-e3ae5a08b713 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:55.296798 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-ad6d92b0-05a8-4bc0-9633-877f8457b8c4 req-ba9f68ca-47c6-492e-a6be-4afb8ecf2f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e407782-18cb-44c7-aeb5-95be87554fb8", "name": "network-vif-unplugged", "status": "completed", "tag": "ca81beba-189f-4dcd-84dc-799c4f2b2989"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:55.306031 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ad6d92b0-05a8-4bc0-9633-877f8457b8c4 req-ba9f68ca-47c6-492e-a6be-4afb8ecf2f12 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:55.306507 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ad6d92b0-05a8-4bc0-9633-877f8457b8c4 req-ba9f68ca-47c6-492e-a6be-4afb8ecf2f12 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:55.320741 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.compute.server_external_events [req-ad6d92b0-05a8-4bc0-9633-877f8457b8c4 req-ba9f68ca-47c6-492e-a6be-4afb8ecf2f12 service nova] Unable to find a host for instance 5e407782-18cb-44c7-aeb5-95be87554fb8. Dropping event network-vif-unplugged {{(pid=117648) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 16 15:27:55.323669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-ad6d92b0-05a8-4bc0-9633-877f8457b8c4 req-ba9f68ca-47c6-492e-a6be-4afb8ecf2f12 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028826 May 16 15:27:55.323669 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 574/1162] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 16 15:27:55.334272 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c80c804-7b60-499b-891a-e3ae5a08b713 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:55.342236 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c80c804-7b60-499b-891a-e3ae5a08b713 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1518 microversion: 2.1 time: 0.169430 May 16 15:27:55.342805 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 589/1163] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:55 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:56.359806 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-652f020b-3c7a-4b02-b162-8d3ddd236d2e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:56.360539 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-652f020b-3c7a-4b02-b162-8d3ddd236d2e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:56.366960 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-652f020b-3c7a-4b02-b162-8d3ddd236d2e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:56.367430 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-652f020b-3c7a-4b02-b162-8d3ddd236d2e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:56.368199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-652f020b-3c7a-4b02-b162-8d3ddd236d2e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:56.368627 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-652f020b-3c7a-4b02-b162-8d3ddd236d2e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:56.500258 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-652f020b-3c7a-4b02-b162-8d3ddd236d2e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:56.507594 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-652f020b-3c7a-4b02-b162-8d3ddd236d2e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1574 microversion: 2.1 time: 0.151860 May 16 15:27:56.508155 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 575/1164] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:56 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:57.524814 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fb590239-3274-47ad-9658-181e565e218d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:57.525346 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fb590239-3274-47ad-9658-181e565e218d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:57.532137 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb590239-3274-47ad-9658-181e565e218d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:57.532581 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb590239-3274-47ad-9658-181e565e218d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:57.533345 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb590239-3274-47ad-9658-181e565e218d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:57.533780 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb590239-3274-47ad-9658-181e565e218d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:57.910443 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fb590239-3274-47ad-9658-181e565e218d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:57.917807 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fb590239-3274-47ad-9658-181e565e218d tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1574 microversion: 2.1 time: 0.397011 May 16 15:27:57.918401 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 590/1165] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:57 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1574 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:58.934833 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e8ce1a72-35f9-4ae7-b454-1aaf1fb86149 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:58.935445 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e8ce1a72-35f9-4ae7-b454-1aaf1fb86149 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:58.942463 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8ce1a72-35f9-4ae7-b454-1aaf1fb86149 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:58.942914 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8ce1a72-35f9-4ae7-b454-1aaf1fb86149 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:58.943681 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8ce1a72-35f9-4ae7-b454-1aaf1fb86149 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:58.944117 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8ce1a72-35f9-4ae7-b454-1aaf1fb86149 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:59.070956 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e8ce1a72-35f9-4ae7-b454-1aaf1fb86149 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:59.078333 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e8ce1a72-35f9-4ae7-b454-1aaf1fb86149 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1574 microversion: 2.1 time: 0.147429 May 16 15:27:59.078933 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 576/1166] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:27:58 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:00.094773 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bb7a27dc-f534-4f1a-a0f2-847833219db7 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:00.095407 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bb7a27dc-f534-4f1a-a0f2-847833219db7 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:00.101654 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb7a27dc-f534-4f1a-a0f2-847833219db7 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:00.102121 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb7a27dc-f534-4f1a-a0f2-847833219db7 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:00.102875 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb7a27dc-f534-4f1a-a0f2-847833219db7 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:00.103301 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb7a27dc-f534-4f1a-a0f2-847833219db7 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:00.229672 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bb7a27dc-f534-4f1a-a0f2-847833219db7 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:00.237460 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bb7a27dc-f534-4f1a-a0f2-847833219db7 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1574 microversion: 2.1 time: 0.146857 May 16 15:28:00.238022 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 591/1167] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:28:00 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:01.254937 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-aef8d68e-fe6f-46c5-937a-0846ad1df04e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:01.255541 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-aef8d68e-fe6f-46c5-937a-0846ad1df04e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:01.261873 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aef8d68e-fe6f-46c5-937a-0846ad1df04e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:01.262356 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aef8d68e-fe6f-46c5-937a-0846ad1df04e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:01.263123 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aef8d68e-fe6f-46c5-937a-0846ad1df04e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:01.263556 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aef8d68e-fe6f-46c5-937a-0846ad1df04e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:01.393274 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-aef8d68e-fe6f-46c5-937a-0846ad1df04e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:01.400665 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-aef8d68e-fe6f-46c5-937a-0846ad1df04e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1574 microversion: 2.1 time: 0.149556 May 16 15:28:01.401234 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 577/1168] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:28:01 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:02.417024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-33c60144-8f07-477a-8e3b-65e76baf563b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:02.417708 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-33c60144-8f07-477a-8e3b-65e76baf563b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:02.427054 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33c60144-8f07-477a-8e3b-65e76baf563b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:02.427493 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33c60144-8f07-477a-8e3b-65e76baf563b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:02.428248 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33c60144-8f07-477a-8e3b-65e76baf563b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:02.428676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33c60144-8f07-477a-8e3b-65e76baf563b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:02.560858 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-33c60144-8f07-477a-8e3b-65e76baf563b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:02.568764 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-33c60144-8f07-477a-8e3b-65e76baf563b tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1574 microversion: 2.1 time: 0.155867 May 16 15:28:02.569345 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 592/1169] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:28:02 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:03.586189 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-aabeb6bc-4b46-4ed2-8557-34788ed743a0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:03.592029 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-aabeb6bc-4b46-4ed2-8557-34788ed743a0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:03.593808 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aabeb6bc-4b46-4ed2-8557-34788ed743a0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:03.594281 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aabeb6bc-4b46-4ed2-8557-34788ed743a0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:03.595039 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aabeb6bc-4b46-4ed2-8557-34788ed743a0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:03.595469 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aabeb6bc-4b46-4ed2-8557-34788ed743a0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:03.720702 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-aabeb6bc-4b46-4ed2-8557-34788ed743a0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:03.728495 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-aabeb6bc-4b46-4ed2-8557-34788ed743a0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1574 microversion: 2.1 time: 0.146166 May 16 15:28:03.729021 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 578/1170] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:28:03 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1574 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:04.745620 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0285794b-9144-4737-a072-fa679416534a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:04.746261 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0285794b-9144-4737-a072-fa679416534a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:04.753271 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0285794b-9144-4737-a072-fa679416534a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:04.753716 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0285794b-9144-4737-a072-fa679416534a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:04.754508 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0285794b-9144-4737-a072-fa679416534a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:04.754937 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0285794b-9144-4737-a072-fa679416534a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:04.880307 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0285794b-9144-4737-a072-fa679416534a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:04.889501 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0285794b-9144-4737-a072-fa679416534a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1574 microversion: 2.1 time: 0.147699 May 16 15:28:04.890089 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 593/1171] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:28:04 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:05.378129 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-861237bc-aa0c-4a91-9a1f-cac598f506f2 req-00e117b9-a814-45a4-a244-9c58fb13f63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e407782-18cb-44c7-aeb5-95be87554fb8", "name": "network-vif-plugged", "status": "completed", "tag": "ca81beba-189f-4dcd-84dc-799c4f2b2989"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:05.386677 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-861237bc-aa0c-4a91-9a1f-cac598f506f2 req-00e117b9-a814-45a4-a244-9c58fb13f63d service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:05.387126 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-861237bc-aa0c-4a91-9a1f-cac598f506f2 req-00e117b9-a814-45a4-a244-9c58fb13f63d service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:05.398290 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-861237bc-aa0c-4a91-9a1f-cac598f506f2 req-00e117b9-a814-45a4-a244-9c58fb13f63d service nova] Creating event network-vif-plugged:ca81beba-189f-4dcd-84dc-799c4f2b2989 for instance 5e407782-18cb-44c7-aeb5-95be87554fb8 on hv-cinder-79578 May 16 15:28:05.403279 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-861237bc-aa0c-4a91-9a1f-cac598f506f2 req-00e117b9-a814-45a4-a244-9c58fb13f63d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028843 May 16 15:28:05.404060 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 579/1172] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:05.906491 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e18017d2-544c-4ca6-a9bf-b1cb0de03199 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:05.907100 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e18017d2-544c-4ca6-a9bf-b1cb0de03199 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:05.915363 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e18017d2-544c-4ca6-a9bf-b1cb0de03199 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:05.915811 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e18017d2-544c-4ca6-a9bf-b1cb0de03199 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:05.916571 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e18017d2-544c-4ca6-a9bf-b1cb0de03199 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:05.917007 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e18017d2-544c-4ca6-a9bf-b1cb0de03199 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:06.043281 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e18017d2-544c-4ca6-a9bf-b1cb0de03199 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:06.051106 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e18017d2-544c-4ca6-a9bf-b1cb0de03199 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1574 microversion: 2.1 time: 0.148587 May 16 15:28:06.051676 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 594/1173] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:28:05 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:07.068523 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7f7b3a33-1af2-4cdc-92a2-b175a7635b96 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:07.069209 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7f7b3a33-1af2-4cdc-92a2-b175a7635b96 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:07.075343 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f7b3a33-1af2-4cdc-92a2-b175a7635b96 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:07.075793 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f7b3a33-1af2-4cdc-92a2-b175a7635b96 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:07.077069 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f7b3a33-1af2-4cdc-92a2-b175a7635b96 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:07.077505 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f7b3a33-1af2-4cdc-92a2-b175a7635b96 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:07.206540 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7f7b3a33-1af2-4cdc-92a2-b175a7635b96 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:07.213922 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7f7b3a33-1af2-4cdc-92a2-b175a7635b96 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1561 microversion: 2.1 time: 0.150065 May 16 15:28:07.214538 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 580/1174] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:28:07 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:20.342148 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-88406878-fdc1-4bc2-8e11-029ec61091f5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:20.342702 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-88406878-fdc1-4bc2-8e11-029ec61091f5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:20.347872 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-377429ad-009e-4b25-871f-3cec88cee66e req-f39eb305-680c-44ba-9ec2-d6e1cbf41fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e407782-18cb-44c7-aeb5-95be87554fb8", "tag": "ca81beba-189f-4dcd-84dc-799c4f2b2989"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:20.349454 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88406878-fdc1-4bc2-8e11-029ec61091f5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:20.349904 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88406878-fdc1-4bc2-8e11-029ec61091f5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:20.350698 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88406878-fdc1-4bc2-8e11-029ec61091f5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:20.351133 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88406878-fdc1-4bc2-8e11-029ec61091f5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:20.356520 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-377429ad-009e-4b25-871f-3cec88cee66e req-f39eb305-680c-44ba-9ec2-d6e1cbf41fa2 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:20.357581 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-377429ad-009e-4b25-871f-3cec88cee66e req-f39eb305-680c-44ba-9ec2-d6e1cbf41fa2 service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:20.368036 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-377429ad-009e-4b25-871f-3cec88cee66e req-f39eb305-680c-44ba-9ec2-d6e1cbf41fa2 service nova] Creating event network-changed:ca81beba-189f-4dcd-84dc-799c4f2b2989 for instance 5e407782-18cb-44c7-aeb5-95be87554fb8 on hv-cinder-79578 May 16 15:29:20.373266 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-377429ad-009e-4b25-871f-3cec88cee66e req-f39eb305-680c-44ba-9ec2-d6e1cbf41fa2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030927 May 16 15:29:20.374154 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 581/1175] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:20.376241 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-88406878-fdc1-4bc2-8e11-029ec61091f5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:29:20.678669 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-88406878-fdc1-4bc2-8e11-029ec61091f5 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 204 len: 0 microversion: 2.1 time: 0.341041 May 16 15:29:20.679520 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 595/1176] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 16 15:29:20 2022] DELETE /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:29:20.689176 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-64b0885a-9298-4fc3-b2f6-55a73503559e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:20.690235 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-64b0885a-9298-4fc3-b2f6-55a73503559e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:20.696727 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64b0885a-9298-4fc3-b2f6-55a73503559e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:20.697179 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64b0885a-9298-4fc3-b2f6-55a73503559e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:20.698199 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64b0885a-9298-4fc3-b2f6-55a73503559e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:20.698647 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64b0885a-9298-4fc3-b2f6-55a73503559e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:20.834131 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-64b0885a-9298-4fc3-b2f6-55a73503559e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:20.841609 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-64b0885a-9298-4fc3-b2f6-55a73503559e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.157214 May 16 15:29:20.842324 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 582/1177] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:29:20 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:21.859860 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-55325a6b-54e5-4bdc-aff0-f67d7d64315e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:21.860551 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-55325a6b-54e5-4bdc-aff0-f67d7d64315e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:21.867022 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55325a6b-54e5-4bdc-aff0-f67d7d64315e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:21.867471 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55325a6b-54e5-4bdc-aff0-f67d7d64315e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:21.868239 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55325a6b-54e5-4bdc-aff0-f67d7d64315e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:21.868674 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55325a6b-54e5-4bdc-aff0-f67d7d64315e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:22.016467 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-55325a6b-54e5-4bdc-aff0-f67d7d64315e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:22.024011 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-55325a6b-54e5-4bdc-aff0-f67d7d64315e tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1567 microversion: 2.1 time: 0.168415 May 16 15:29:22.024660 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 596/1178] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:29:21 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:22.947945 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-c8cb6f86-99c2-48c2-b1ab-aa44dda73441 req-676df813-98f4-4d3a-bd6f-1fbcd6a386cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e407782-18cb-44c7-aeb5-95be87554fb8", "name": "network-vif-deleted", "tag": "ca81beba-189f-4dcd-84dc-799c4f2b2989"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:22.956341 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-c8cb6f86-99c2-48c2-b1ab-aa44dda73441 req-676df813-98f4-4d3a-bd6f-1fbcd6a386cb service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:22.965484 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-c8cb6f86-99c2-48c2-b1ab-aa44dda73441 req-676df813-98f4-4d3a-bd6f-1fbcd6a386cb service nova] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:22.967592 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-c8cb6f86-99c2-48c2-b1ab-aa44dda73441 req-676df813-98f4-4d3a-bd6f-1fbcd6a386cb service nova] Creating event network-vif-deleted:ca81beba-189f-4dcd-84dc-799c4f2b2989 for instance 5e407782-18cb-44c7-aeb5-95be87554fb8 on hv-cinder-79578 May 16 15:29:22.973423 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-c8cb6f86-99c2-48c2-b1ab-aa44dda73441 req-676df813-98f4-4d3a-bd6f-1fbcd6a386cb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029249 May 16 15:29:22.974077 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 583/1179] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 16 15:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:23.042091 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ff6247b1-13f5-454c-a065-bb4e290385b8 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:23.042705 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ff6247b1-13f5-454c-a065-bb4e290385b8 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:23.049577 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff6247b1-13f5-454c-a065-bb4e290385b8 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:23.050024 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff6247b1-13f5-454c-a065-bb4e290385b8 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:23.050879 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff6247b1-13f5-454c-a065-bb4e290385b8 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:23.051326 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff6247b1-13f5-454c-a065-bb4e290385b8 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:23.112416 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff6247b1-13f5-454c-a065-bb4e290385b8 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:23.121518 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ff6247b1-13f5-454c-a065-bb4e290385b8 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1382 microversion: 2.1 time: 0.083225 May 16 15:29:23.122189 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 597/1180] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:29:23 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1382 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:24.139954 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0afefc60-cfc7-487b-9b70-58e1acfce9f0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:24.140673 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0afefc60-cfc7-487b-9b70-58e1acfce9f0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:24.147187 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0afefc60-cfc7-487b-9b70-58e1acfce9f0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:24.152147 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0afefc60-cfc7-487b-9b70-58e1acfce9f0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:24.152147 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0afefc60-cfc7-487b-9b70-58e1acfce9f0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:24.152147 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0afefc60-cfc7-487b-9b70-58e1acfce9f0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:24.179852 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0afefc60-cfc7-487b-9b70-58e1acfce9f0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:24.180218 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0afefc60-cfc7-487b-9b70-58e1acfce9f0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:24.180653 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-0afefc60-cfc7-487b-9b70-58e1acfce9f0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lazy-loading 'fault' on Instance uuid 5e407782-18cb-44c7-aeb5-95be87554fb8 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:29:24.221871 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0afefc60-cfc7-487b-9b70-58e1acfce9f0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4109353d2bd843bf9756404990ea6832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6bd797b8e04be18b7484855142b067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:24.229316 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0afefc60-cfc7-487b-9b70-58e1acfce9f0 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 200 len: 1224 microversion: 2.1 time: 0.094278 May 16 15:29:24.230768 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 584/1181] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:29:24 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:25.246789 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dce90738-cb74-45ff-827d-d5fe54539f12 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:25.247395 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dce90738-cb74-45ff-827d-d5fe54539f12 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] [instance: 5e407782-18cb-44c7-aeb5-95be87554fb8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:25.254235 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dce90738-cb74-45ff-827d-d5fe54539f12 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:25.254679 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dce90738-cb74-45ff-827d-d5fe54539f12 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:25.255441 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dce90738-cb74-45ff-827d-d5fe54539f12 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:25.255872 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dce90738-cb74-45ff-827d-d5fe54539f12 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Lock "1579528c-849f-42a7-b29b-4c61d7971040" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:25.269731 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-dce90738-cb74-45ff-827d-d5fe54539f12 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] HTTP exception thrown: Instance 5e407782-18cb-44c7-aeb5-95be87554fb8 could not be found. May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dce90738-cb74-45ff-827d-d5fe54539f12 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Request method failure captured: May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 HTTP/1.1 May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept: application/json May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Connection: close May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Length: 0 May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Content-Type: application/json May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Host: 10.222.0.44 May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABigmzDx4coEKIFgsa7mzlGwvZL4X_uUhcJDPEK709SH8DYnJYLaTFTbpgqa056JjpXpBTodA2yVySaqiQAsudDl4EC3tdkZb6zMWwo5lelRlsQMESm5PFofpdPAinwy2V9rZnF3mKpanoE7s7VAGC5I3Vcbtj3yFckpcUODOH_K1I4RWo May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Id: None May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Domain-Name: None May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Id: 0b6bd797b8e04be18b7484855142b067 May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-TestShelveInstance-445039028 May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Role: reader,member May 16 15:29:25.271382 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Roles: reader,member May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0b6bd797b8e04be18b7484855142b067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0b6bd797b8e04be18b7484855142b067"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0b6bd797b8e04be18b7484855142b067"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0b6bd797b8e04be18b7484855142b067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-TestShelveInstance-445039028 May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 0b6bd797b8e04be18b7484855142b067 May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-TestShelveInstance-445039028 May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User: tempest-TestShelveInstance-445039028-project May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Id: 4109353d2bd843bf9756404990ea6832 May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-TestShelveInstance-445039028-project May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: method: > May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: exception: Instance 5e407782-18cb-44c7-aeb5-95be87554fb8 could not be found. May 16 15:29:25.273108 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: action_args: {'id': '5e407782-18cb-44c7-aeb5-95be87554fb8'} May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e407782-18cb-44c7-aeb5-95be87554fb8 could not be found. May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:25.274224 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e407782-18cb-44c7-aeb5-95be87554fb8 could not be found. May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e407782-18cb-44c7-aeb5-95be87554fb8 could not be found. May 16 15:29:25.275960 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi May 16 15:29:25.277790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dce90738-cb74-45ff-827d-d5fe54539f12 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Returning 404 to user: Instance 5e407782-18cb-44c7-aeb5-95be87554fb8 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:25.277790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dce90738-cb74-45ff-827d-d5fe54539f12 tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8" status: 404 len: 111 microversion: 2.1 time: 0.029845 May 16 15:29:25.277790 dv-cinder-795785-10-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 598/1182] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 16 15:29:25 2022] GET /compute/v2.1/servers/5e407782-18cb-44c7-aeb5-95be87554fb8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:29:25.490916 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-784b63e1-3442-4111-babb-2bbcd7346c5a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] Calling method '.version_select at 0x7fc9a6dae310>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:25.550744 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-784b63e1-3442-4111-babb-2bbcd7346c5a tempest-TestShelveInstance-445039028 tempest-TestShelveInstance-445039028-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-226025383" status: 202 len: 0 microversion: 2.1 time: 0.063580 May 16 15:29:25.551338 dv-cinder-795785-10-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 585/1183] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 16 15:29:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-226025383 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)